-- Logs begin at Mon 2022-06-27 17:38:29 UTC, end at Mon 2022-06-27 19:05:48 UTC. -- Jun 27 18:36:06.067472 dv-cinder-844601-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 27 18:36:06.078618 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 27 18:36:06.078618 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 27 18:36:06 2022] *** Jun 27 18:36:06.078618 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 27 18:36:06.078618 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 27 18:36:06.078618 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: nodename: dv-cinder-844601-6-iscsi Jun 27 18:36:06.078618 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: machine: x86_64 Jun 27 18:36:06.078618 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: clock source: unix Jun 27 18:36:06.078618 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: pcre jit disabled Jun 27 18:36:06.078618 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: detected number of CPU cores: 4 Jun 27 18:36:06.078618 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: current working directory: / Jun 27 18:36:06.078618 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: detected binary path: /usr/bin/uwsgi-core Jun 27 18:36:06.078618 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: your processes number limit is 47680 Jun 27 18:36:06.078618 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: your memory page size is 4096 bytes Jun 27 18:36:06.078618 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: detected max file descriptor number: 2048 Jun 27 18:36:06.078618 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: lock engine: pthread robust mutexes Jun 27 18:36:06.078618 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: thunder lock: enabled Jun 27 18:36:06.080039 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 27 18:36:06.080039 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 27 18:36:06.122436 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: Python main interpreter initialized at 0x55d128c559c0 Jun 27 18:36:06.122436 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: python threads support enabled Jun 27 18:36:06.122436 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: your server socket listen backlog is limited to 100 connections Jun 27 18:36:06.122436 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: your mercy for graceful operations on workers is 90 seconds Jun 27 18:36:06.122792 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: mapped 403077 bytes (393 KB) for 2 cores Jun 27 18:36:06.122873 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: *** Operational MODE: preforking *** Jun 27 18:36:06.123100 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: *** uWSGI is running in multiple interpreter mode *** Jun 27 18:36:06.123100 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: spawned uWSGI master process (pid: 110197) Jun 27 18:36:06.123292 dv-cinder-844601-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 27 18:36:06.124406 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: spawned uWSGI worker 1 (pid: 110198, cores: 1) Jun 27 18:36:06.124406 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: spawned uWSGI worker 2 (pid: 110199, cores: 1) Jun 27 18:36:06.124406 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 27 18:36:06.783597 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 18:36:06.784649 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 18:36:07.910259 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 18:36:07.910259 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: from cryptography.utils import int_from_bytes Jun 27 18:36:07.911287 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 18:36:07.911287 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: from cryptography.utils import int_from_bytes Jun 27 18:36:07.913011 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 18:36:07.913011 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: from cryptography.utils import int_from_bytes Jun 27 18:36:07.913464 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 18:36:07.913464 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: from cryptography.utils import int_from_bytes Jun 27 18:36:10.400112 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 18:36:10.400694 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 18:36:10.400876 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 18:36:10.401230 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 18:36:10.401481 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 18:36:10.401864 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.402186 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.402393 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 18:36:10.402774 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.402865 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 18:36:10.402946 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.403143 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.403230 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 18:36:10.403449 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.403545 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 18:36:10.403766 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.403863 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 18:36:10.404081 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.404174 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.404402 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.404489 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.404657 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.404774 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.404966 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.405094 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.405284 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844601-6-iscsi {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.405424 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.405599 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.405734 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.405901 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.406059 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.406206 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.406403 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.406542 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.406733 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.406841 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.406997 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.407155 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.407312 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.407454 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.407636 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844601-6-iscsi {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.407949 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.408058 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.408257 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.408371 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.408568 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.408688 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.408888 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.409026 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.409198 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.409320 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.409520 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.409624 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.409831 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.409920 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.410178 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.410320 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.410588 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.410793 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.410918 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.411107 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.411256 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.411419 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.411595 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844601-6-iscsi {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.411756 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.411907 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.412071 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.412213 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.412382 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.412519 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.412703 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.412926 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.413013 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.413231 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.413327 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.413531 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.413625 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.413844 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.414002 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844601-6-iscsi {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.414159 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.414317 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.414483 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.414669 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.414803 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.414984 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.415115 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.415398 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.415496 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.415711 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.415799 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.416005 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.416090 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.416307 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.416409 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.416609 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.416696 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.416918 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.417005 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.417218 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.417305 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.417513 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.417600 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.417758 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.417851 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.418066 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.418155 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.418415 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.418507 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.418713 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.418799 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.419026 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.419119 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.419271 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.419366 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.419582 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.419691 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.419824 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.419971 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.420136 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.420244 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.420440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.420548 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.420737 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.420831 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.421035 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.421141 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.421334 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.421425 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.421631 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.421724 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.421918 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.422015 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.422214 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.422300 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.422535 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.422637 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.422847 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.422943 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.423154 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.423241 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.423460 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.423545 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.423757 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.423856 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.424062 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.424149 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.424370 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.424457 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.424679 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.424779 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.424977 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.425070 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.425292 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.425378 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.425606 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.425704 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.425907 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.425993 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.426804 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.427127 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.427225 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.427501 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.427596 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.427760 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.427848 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.428070 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.428165 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.428404 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.428491 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.428722 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.428814 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.429029 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.429122 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.429347 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.429442 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.429595 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.429740 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.429893 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.429996 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.430192 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.430322 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.430535 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.430673 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.430838 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.430954 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.431135 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.431252 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.431441 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.431533 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.431727 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.431819 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.432027 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.432117 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.432324 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.432414 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.432621 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.432713 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.432919 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.433012 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.433216 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.433308 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.433511 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.433603 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.433810 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.433900 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.434108 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.434198 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.434422 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.434516 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.434734 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.434825 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.435041 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.435133 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.435336 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.435433 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.435633 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.435724 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.435930 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.436036 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.436227 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.436319 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.436529 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.436619 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.436825 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.436916 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.437120 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.437212 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.437431 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.437530 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.437728 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.437828 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.438024 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.438123 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.438326 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.438434 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.438649 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.438756 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.438951 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.439042 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.439258 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.439348 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.439549 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.439648 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.439847 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.439940 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.440155 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.440255 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.440453 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.440554 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.440750 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.440843 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.441044 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.441143 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.441340 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.441441 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.441637 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.442551 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.442551 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.442815 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.442916 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.443012 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.443121 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.443209 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.443429 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.443525 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.443736 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.443824 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.444041 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.444128 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.444347 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.444434 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.444653 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.444743 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.444957 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.445044 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.445261 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.445348 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.445562 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.445661 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.445880 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.445968 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.446202 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.446298 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.446536 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.446628 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.446847 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.446934 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.447155 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.447256 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.447473 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:36:10.447561 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.447781 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.447875 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.448095 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.448190 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.448416 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.448511 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.448726 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.448813 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.449036 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.449131 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.449351 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.449441 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.449667 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.449756 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.449981 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.450077 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.450303 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.450428 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.450640 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.450731 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.450950 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.451079 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.451264 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.451403 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.451570 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.451696 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.451881 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.452011 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.452203 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.452336 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.452517 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.452654 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.452822 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.452952 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.453146 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.453272 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.453468 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.453605 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.453777 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.453903 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.454092 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.454219 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.454463 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.454607 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.454744 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.454880 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.455011 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.455135 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.455321 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.455460 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.455638 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.455766 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.455970 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.456099 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.456277 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.456412 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.456590 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.456717 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.456896 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.457023 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.457200 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.457350 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.457612 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.457746 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.457921 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.458056 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.458227 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.458365 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.458580 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.458721 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.458890 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.459019 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.459200 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.459336 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.459512 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.459639 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.459822 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.459956 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.460127 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.460257 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.460434 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.460570 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.460739 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.460867 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.461037 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.461173 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.461334 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.461462 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.461632 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.461759 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.461937 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.462065 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.462234 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.462369 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.462573 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.462713 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.462893 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.463022 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.463192 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.463334 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.463530 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.463677 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.463805 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.463929 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.464087 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.464214 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.464388 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.464525 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.464690 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.464818 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.464988 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.465116 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.465293 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.465436 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.465595 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.465723 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.465894 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.466023 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.466211 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.466351 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.466546 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.466687 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.466849 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.466984 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.467154 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.467282 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.467456 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.467589 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.467757 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.467886 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.468088 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.468213 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.468360 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.468493 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.468665 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.468793 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.468970 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.469096 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.469293 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.469422 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.469601 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.469734 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.469914 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.470042 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.470229 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.470357 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.470570 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.470702 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.470883 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.471011 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.471194 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.471322 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.471506 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.471646 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.471831 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.471960 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.472143 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.472283 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.472445 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.472581 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.472752 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.472880 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.473105 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.473244 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.473413 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.473551 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.473756 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.473891 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.474086 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.474219 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.474405 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.474538 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.474711 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.474839 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.475014 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.475142 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.475314 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.475444 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.475614 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.475743 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.475920 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.476055 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.476220 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.476346 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.476519 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.476654 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.476817 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.476960 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.477116 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.477245 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.477423 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.477575 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.477732 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.477869 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.478057 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.478194 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.478396 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.478527 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.478700 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.478846 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.479011 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.479141 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.479318 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.479455 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.479628 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.479767 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.479935 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.480063 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.480242 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.480368 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.480546 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.480686 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.480849 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.480988 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.481161 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.481289 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.481467 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.481602 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.481779 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.481906 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.482085 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.482220 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.482437 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.482580 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.482732 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.482859 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.483043 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.483171 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.483342 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.483471 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.483652 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.483779 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.483985 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.484111 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.484300 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.484429 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.484609 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.484778 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.484916 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.485046 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.485212 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.485338 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.485521 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.485647 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.485828 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.485968 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.486134 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.486260 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.486461 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.486589 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.486767 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.486906 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.487080 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.487207 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.487386 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.487520 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.487700 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.488090 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.488264 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.488399 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.489107 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.489238 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.489426 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.489562 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.489744 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.489870 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.490072 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.490198 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.490480 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.490611 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.490747 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.490870 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.491038 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.491157 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.491365 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.491490 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.491672 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.491800 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.491990 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.492116 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.492295 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.492423 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.492600 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.492727 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.492908 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.493035 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.493209 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.493337 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.493508 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.493635 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.493814 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.493951 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.494123 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.494251 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.494449 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.494579 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.494758 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.494900 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.495060 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.495188 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.495369 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.495497 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.495673 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.495810 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.495974 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.496110 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.496274 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.496401 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.496577 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.496717 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.496892 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.497030 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.497198 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.497324 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.497521 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.497646 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.497811 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.497939 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.498111 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.498239 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.498431 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.498563 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.498747 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.498873 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.499055 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.499194 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.499354 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.499483 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.499651 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.499785 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.499948 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.500076 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.500283 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.500413 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.500589 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.500715 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.500895 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.501022 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.501187 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.501317 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.501504 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.501637 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.501808 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.501943 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.502112 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.502239 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.502433 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.502575 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.502740 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.502881 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.503054 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.503181 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.503360 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.503495 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.503664 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.503805 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.503966 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.504093 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.504863 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.505015 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.505168 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.505308 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.505472 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.505601 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.505788 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.505923 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.506091 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.506222 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.506414 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.506547 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.506724 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.506852 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.507022 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.507152 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.507323 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.507453 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.507635 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.507761 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.507960 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.508195 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.508330 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.508525 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.508654 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.508836 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.508972 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.509157 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.509286 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.509467 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.509595 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.509778 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.509905 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.510103 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.510343 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.510501 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.510706 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.510847 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.511024 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.511161 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.511349 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.511477 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.511654 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.511782 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.511954 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.512084 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.512260 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.512395 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.512559 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.512695 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.512858 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.512987 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.513157 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.513308 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.513504 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.513643 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.513770 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.513902 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.514026 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.514149 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.514319 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.514516 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.514643 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.514778 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.514945 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.515080 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.515245 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.515374 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.515550 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.515687 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.515847 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.515975 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.516160 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.516288 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.516464 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.516593 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.516762 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.516893 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.517059 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.517186 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.517357 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.517486 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.517692 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.517825 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.517989 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.518117 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.518313 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.518458 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.518653 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.518792 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.518961 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.519090 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.519267 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.519397 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.519566 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.519692 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.519942 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.520081 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.520246 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.520375 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.520597 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.520731 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.520927 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.521069 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.521273 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.521401 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.521579 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.521706 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.521878 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.522084 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.522212 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.522335 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.522496 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.522620 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.522792 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.522921 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.523097 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.523226 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.523393 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.523529 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.523698 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.523827 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.523996 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.524131 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.524306 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.524440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.524607 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.524735 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.524933 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.525073 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.525198 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.525322 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.525478 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.525608 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.525781 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.525910 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.526078 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.526216 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.526403 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.526536 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.526699 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.526844 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.527008 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.527146 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.527307 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.527449 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.527604 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.527732 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.527900 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.528041 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.528187 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.528423 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.528581 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.528715 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.528839 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.528972 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.529096 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.529219 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.529373 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.529511 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.529670 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.529811 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.529968 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.530097 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.530271 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.530422 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.530592 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.530722 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.530889 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.531024 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.531191 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.531321 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.531509 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.531638 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.531814 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.531940 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.532111 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.532237 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.532415 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.532544 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.532713 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.532841 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.533018 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.533333 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.533730 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.533859 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.533974 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.534080 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.534268 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.534425 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.534609 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.534738 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.534917 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.535032 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.535226 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.535349 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.535584 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.535899 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.536204 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.536315 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.536512 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.536637 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.536818 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.536940 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.537123 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.537239 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.537430 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.537560 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.537755 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.537884 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.538058 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.538185 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.538365 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.538550 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.538688 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.538880 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.539009 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.539247 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.539384 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.539555 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.539683 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.539869 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.539998 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.540187 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.540324 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.540496 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.540623 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.540804 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.540939 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.541114 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.541251 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.541417 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.541552 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.541730 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.541858 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.542037 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.542167 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.542346 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.542490 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.542680 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.542808 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.542981 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.543113 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.543285 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.543411 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.543591 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.543717 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.543897 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.544035 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.544210 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.544337 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.544524 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.544658 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.544841 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.544968 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.545142 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.545271 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.545448 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.545585 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.545753 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.545881 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.546058 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.546185 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.546362 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.546521 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.546689 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.546818 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.546995 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.547129 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.547300 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.547438 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.547606 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.547735 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.547913 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.548042 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.548217 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.548358 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.548519 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.548646 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.548825 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.548953 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.549131 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.549265 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.549428 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.549554 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.549743 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.549870 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.550048 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.550174 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.550348 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.550559 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.550716 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.550843 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.551556 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.551759 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.551950 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.552096 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.552265 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.552401 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.552536 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.552661 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.552784 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.552906 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.553135 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.553273 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.553435 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.553568 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.553741 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.553868 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.554047 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.554182 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.554355 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.554496 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.554689 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.554819 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.554991 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.555127 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.555308 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.555435 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.555617 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.555746 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.555989 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.556124 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.556294 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.556422 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.556593 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.556720 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.556892 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.557020 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.557196 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.557324 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.557512 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.557639 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.557818 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.557947 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.558109 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.558236 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.558421 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.558552 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.558739 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.558869 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.559038 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.559167 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.559351 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.559487 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.559657 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.559796 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.559979 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.560107 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.560338 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.560476 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.560704 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.560831 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.561012 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.561140 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.561331 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.561465 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.561645 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.561766 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.561960 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.562089 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.562275 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.562464 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.562591 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.562703 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.562891 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.563044 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.563199 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.563349 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.563508 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.563643 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.563822 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.563949 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.564129 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.564257 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.564427 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.564563 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.564727 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.564855 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.565042 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.565179 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.565360 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.565488 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.565667 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.565795 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.565982 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.566118 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.566311 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.566458 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.566694 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.567417 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.567644 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.567775 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.567968 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.568099 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.568284 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.568420 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.568609 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.568744 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.568913 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.569040 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.569220 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.569351 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.569527 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.569671 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.569824 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.569951 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.570133 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.570260 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.570471 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.570611 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.570797 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.570932 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.571105 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.571235 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.571419 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.571557 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.571721 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.571841 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.572023 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.572151 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.572327 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.572464 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.572629 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.572762 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.572946 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.573075 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.573250 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.573384 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.573565 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.573691 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.573879 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.574013 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.574176 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.574304 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.574518 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.574660 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.574825 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.574953 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.575126 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.575255 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.575424 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.575552 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.575725 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.575854 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.576029 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.576157 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.576336 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.576465 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.576657 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.576790 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.576978 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.577105 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.577298 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.577424 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.577603 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.577742 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.577930 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.578060 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.578244 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.578394 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.578580 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.578720 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.578897 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.579026 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.579216 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.579344 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.579524 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.579669 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.579823 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.579953 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.580129 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.580258 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.580428 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.580556 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.580728 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.580857 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.581028 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.581156 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.581333 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.581462 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.581630 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.581763 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.581929 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.582058 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.582227 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.582453 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.582603 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.582876 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.583107 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.583235 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.583418 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.583548 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.583742 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.583871 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.584053 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.584191 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.584358 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.584487 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.584678 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.584808 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.584962 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.585101 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.585300 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.585429 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.585604 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.585738 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.585932 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.586068 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.586249 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.586376 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.586592 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.586720 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.586917 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.587058 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.587224 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.587352 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.587542 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.587677 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.587855 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.587985 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.588169 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.588297 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.588477 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.588603 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.588787 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.588923 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.589098 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.589226 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.589408 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.589543 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.589721 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.589849 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.590027 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.590154 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.590340 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.590491 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.590675 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.590805 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.590988 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.591117 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.591511 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.591691 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.591818 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.591942 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.592132 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.592268 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.592442 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.592580 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.592749 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.592878 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.593057 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.593186 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.593364 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.593502 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.593671 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.593800 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.593975 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.594104 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.594282 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.594487 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.594617 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.594742 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.594920 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.595056 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.595237 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.595374 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.595556 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.595685 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.595883 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.596011 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.596193 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.596321 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.596502 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.596639 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.596811 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.596952 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.597117 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.597245 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.597464 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.597596 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.597771 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.597938 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.598173 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.598519 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.598651 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.598845 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.599049 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.599176 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.599284 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.599465 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.599602 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.599779 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.599916 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.600096 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.600232 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.600416 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.600545 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.600732 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.600871 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.601045 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.601172 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.601355 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.601477 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.601666 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.601803 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.601978 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.602114 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.602299 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.602450 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.602653 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.602791 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.602968 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.603088 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.603088 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.603485 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.603603 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.603728 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.603874 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.604100 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.604388 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.604526 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.604700 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.604829 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.605027 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.605157 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.605348 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.605484 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.605668 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.605796 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.605980 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.606115 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.606297 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.606523 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.606653 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.606776 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.606930 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.607059 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.607229 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.607366 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.607538 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.607667 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.607843 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.607971 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.608142 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.608271 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.608460 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.608590 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.608767 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.608894 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.609068 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.609197 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.609385 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.609523 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.609692 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.609921 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.610223 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.610363 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.610589 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.610720 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.610935 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.611062 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.611266 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.611395 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.611586 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.611712 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.611897 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.612034 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.612198 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.612334 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.612516 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.612646 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.613082 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.613216 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.613392 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.614064 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.614278 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.614431 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.614717 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.614860 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.614986 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.615119 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.615243 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.615376 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.615502 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.615640 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.615787 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.615925 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.616088 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.616248 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.616386 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.616558 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.616687 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.616892 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.617021 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.617204 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.617349 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.617516 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.617646 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.617827 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.617959 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.618142 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.618280 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.618463 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.618593 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.618768 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.618906 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.619072 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.619210 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.619374 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.619511 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.619683 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.619821 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.619983 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.620113 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.620294 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.620423 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.620593 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.620725 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.620900 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.621030 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.621201 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.621339 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.621505 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.621634 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.621854 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.621984 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.622174 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.622304 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.622498 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.622628 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.622800 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.622939 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.623112 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.623242 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.623421 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.623559 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.623738 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.623876 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.624046 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.624175 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.624351 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.624489 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.624692 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.624829 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.625004 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.625142 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.625530 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.625669 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.625860 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.625992 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.626178 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.626307 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.626535 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.626684 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.626865 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.626996 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.627170 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.627298 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.627474 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.627603 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.627776 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.627906 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.628098 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.628239 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.628407 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.628537 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.628715 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.628844 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.629021 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.629187 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.629998 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.630324 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.630472 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.630660 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.630789 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.630972 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.631103 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.631282 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.631410 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.631590 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.631727 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.631897 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.632027 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.632207 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.632336 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.632515 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.632643 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.632821 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.632951 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.633132 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.633268 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.633468 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.633609 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.633780 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.633909 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.634091 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.634226 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.634423 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.634568 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.634738 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.634874 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.635044 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.635172 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.635350 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.635489 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.635655 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.635791 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.635959 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.636088 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.636267 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.636406 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.636590 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.636728 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.636900 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.637028 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.637226 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.637353 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.637547 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.637674 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.637895 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.638022 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.638211 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.638349 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.638550 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.638676 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.638849 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.638978 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.639166 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.639296 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.639484 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.639614 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.639790 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.639927 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.640112 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.640241 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.640417 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.640546 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.640739 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.640876 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.641074 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.641203 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.641396 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.641525 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.641715 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.641853 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.642017 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.642145 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.642316 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.642473 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.642640 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.642770 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.642945 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.643083 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.643258 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.643394 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.643561 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.643689 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.643860 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.643988 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.644158 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.644288 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.644461 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.644597 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.644782 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.645004 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.645200 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.645316 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.645506 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.645645 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.645810 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.645967 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.646103 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.646282 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.646434 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.646627 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.646757 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.646938 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.647075 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.647247 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.647377 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.647556 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.647685 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.647856 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.647991 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.648163 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.648290 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.648461 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.648596 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.648762 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.648890 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.649061 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.649189 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.649359 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.649480 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.649657 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.649794 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.649961 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.650089 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.650314 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.650553 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.650682 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.650819 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.650945 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.651069 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.651224 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.651353 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.651541 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.651679 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.651880 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.652006 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.652166 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.652296 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.652484 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.652612 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.652791 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.652927 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.653099 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.653228 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.653422 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.653549 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.653728 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.653855 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.654034 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.654163 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.654341 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.654502 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.654671 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.654800 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.654978 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.655107 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.655283 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.655413 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.655600 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.655727 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.655919 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.656057 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.656222 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.656351 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.656542 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.656670 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.656854 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.656992 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.657169 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.657306 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.657481 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.657609 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.657785 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.657922 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.658106 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.658233 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.658434 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.658566 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.658747 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.658885 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.659058 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.659186 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.659364 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.659494 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.659671 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.659807 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.659984 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.660111 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.660297 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.660960 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.661168 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.661298 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.661493 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.661680 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.661808 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.662019 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.662148 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.662353 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.662511 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.662732 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.662861 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.663065 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.663202 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.663391 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.663523 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.663716 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.663844 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.664029 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.664158 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.664338 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.664470 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.664640 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.664769 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.664901 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 18:36:10.665027 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.665310 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.665618 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:36:10.665864 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 18:36:10.727447 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO dbcounter [None req-77349b76-a558-42bf-bf30-de8da2e7d48e None None] Registered counter for database nova_api Jun 27 18:36:10.728549 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO dbcounter [None req-ebfb1dff-a9a0-4709-a7b5-3c524ab9f58c None None] Registered counter for database nova_api Jun 27 18:36:10.841169 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG oslo_db.sqlalchemy.engines [None req-ebfb1dff-a9a0-4709-a7b5-3c524ab9f58c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 18:36:10.844562 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG oslo_db.sqlalchemy.engines [None req-77349b76-a558-42bf-bf30-de8da2e7d48e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 18:36:10.847737 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG dbcounter [-] [110198] Writer thread running {{(pid=110198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 18:36:10.851986 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG dbcounter [-] [110199] Writer thread running {{(pid=110199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 18:36:10.904822 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.context [None req-ebfb1dff-a9a0-4709-a7b5-3c524ab9f58c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),22329c9e-12ee-4fdf-a1a3-6d021f43d687(cell1) {{(pid=110198) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 18:36:10.907970 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.context [None req-77349b76-a558-42bf-bf30-de8da2e7d48e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),22329c9e-12ee-4fdf-a1a3-6d021f43d687(cell1) {{(pid=110199) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 18:36:10.908707 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG oslo_concurrency.lockutils [None req-ebfb1dff-a9a0-4709-a7b5-3c524ab9f58c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:36:10.910300 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG oslo_concurrency.lockutils [None req-ebfb1dff-a9a0-4709-a7b5-3c524ab9f58c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:36:10.911663 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG oslo_concurrency.lockutils [None req-ebfb1dff-a9a0-4709-a7b5-3c524ab9f58c None None] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:36:10.912410 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG oslo_concurrency.lockutils [None req-77349b76-a558-42bf-bf30-de8da2e7d48e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:36:10.913735 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG oslo_concurrency.lockutils [None req-ebfb1dff-a9a0-4709-a7b5-3c524ab9f58c None None] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:36:10.913980 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG oslo_concurrency.lockutils [None req-77349b76-a558-42bf-bf30-de8da2e7d48e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:36:10.914793 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG oslo_concurrency.lockutils [None req-77349b76-a558-42bf-bf30-de8da2e7d48e None None] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:36:10.915745 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO dbcounter [None req-ebfb1dff-a9a0-4709-a7b5-3c524ab9f58c None None] Registered counter for database nova_cell0 Jun 27 18:36:10.916840 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG oslo_concurrency.lockutils [None req-77349b76-a558-42bf-bf30-de8da2e7d48e None None] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:36:10.918814 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO dbcounter [None req-77349b76-a558-42bf-bf30-de8da2e7d48e None None] Registered counter for database nova_cell0 Jun 27 18:36:10.919594 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO dbcounter [None req-ebfb1dff-a9a0-4709-a7b5-3c524ab9f58c None None] Registered counter for database nova_cell1 Jun 27 18:36:10.922540 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO dbcounter [None req-77349b76-a558-42bf-bf30-de8da2e7d48e None None] Registered counter for database nova_cell1 Jun 27 18:36:10.928512 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG oslo_db.sqlalchemy.engines [None req-ebfb1dff-a9a0-4709-a7b5-3c524ab9f58c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 18:36:10.929504 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG oslo_db.sqlalchemy.engines [None req-ebfb1dff-a9a0-4709-a7b5-3c524ab9f58c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 18:36:10.931562 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG oslo_db.sqlalchemy.engines [None req-77349b76-a558-42bf-bf30-de8da2e7d48e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 18:36:10.933885 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG oslo_db.sqlalchemy.engines [None req-77349b76-a558-42bf-bf30-de8da2e7d48e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 18:36:10.936375 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG dbcounter [-] [110198] Writer thread running {{(pid=110198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 18:36:10.938420 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG dbcounter [-] [110198] Writer thread running {{(pid=110198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 18:36:10.939085 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG dbcounter [-] [110199] Writer thread running {{(pid=110199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 18:36:10.944400 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG dbcounter [-] [110199] Writer thread running {{(pid=110199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 18:36:11.089169 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO dbcounter [None req-ebfb1dff-a9a0-4709-a7b5-3c524ab9f58c None None] Registered counter for database nova_cell0 Jun 27 18:36:11.091444 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO dbcounter [None req-77349b76-a558-42bf-bf30-de8da2e7d48e None None] Registered counter for database nova_cell0 Jun 27 18:36:11.097387 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG oslo_db.sqlalchemy.engines [None req-ebfb1dff-a9a0-4709-a7b5-3c524ab9f58c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 18:36:11.100986 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG oslo_db.sqlalchemy.engines [None req-77349b76-a558-42bf-bf30-de8da2e7d48e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 18:36:11.102100 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG dbcounter [-] [110198] Writer thread running {{(pid=110198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 18:36:11.105892 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG dbcounter [-] [110199] Writer thread running {{(pid=110199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 18:36:11.539249 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: WARNING keystonemiddleware.auth_token [None req-ebfb1dff-a9a0-4709-a7b5-3c524ab9f58c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 18:36:11.546685 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: WARNING keystonemiddleware.auth_token [None req-ebfb1dff-a9a0-4709-a7b5-3c524ab9f58c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 18:36:11.559862 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: WARNING keystonemiddleware.auth_token [None req-77349b76-a558-42bf-bf30-de8da2e7d48e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 18:36:11.567890 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: WARNING keystonemiddleware.auth_token [None req-77349b76-a558-42bf-bf30-de8da2e7d48e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 18:36:11.891696 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: WARNING keystonemiddleware.auth_token [None req-ebfb1dff-a9a0-4709-a7b5-3c524ab9f58c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 18:36:11.897808 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: WARNING keystonemiddleware.auth_token [None req-ebfb1dff-a9a0-4709-a7b5-3c524ab9f58c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 18:36:11.902924 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d128c559c0 pid: 110198 (default app) Jun 27 18:36:11.904971 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-ebfb1dff-a9a0-4709-a7b5-3c524ab9f58c None None] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:36:11.906150 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-ebfb1dff-a9a0-4709-a7b5-3c524ab9f58c None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001717 Jun 27 18:36:11.906593 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Mon Jun 27 18:36:11 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:36:11.910234 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: WARNING keystonemiddleware.auth_token [None req-77349b76-a558-42bf-bf30-de8da2e7d48e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 18:36:11.916445 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: WARNING keystonemiddleware.auth_token [None req-77349b76-a558-42bf-bf30-de8da2e7d48e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 18:36:11.921538 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d128c559c0 pid: 110199 (default app) Jun 27 18:37:29.368494 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-ebfb1dff-a9a0-4709-a7b5-3c524ab9f58c None None] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:37:29.369511 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-ebfb1dff-a9a0-4709-a7b5-3c524ab9f58c None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jun 27 18:37:29.369902 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 930 bytes} [Mon Jun 27 18:37:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:37:29.382728 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG dbcounter [-] [110199] Writing DB stats nova_api:SELECT=3 {{(pid=110199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:37:29.383860 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG dbcounter [-] [110199] Writing DB stats nova_cell1:SELECT=3 {{(pid=110199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:37:29.384850 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG dbcounter [-] [110199] Writing DB stats nova_cell0:SELECT=3 {{(pid=110199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:37:29.385574 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG dbcounter [-] [110199] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:37:29.826261 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-7e623bcd-dda5-404b-a812-7c6ea45630b7 admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:37:29.856395 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-7e623bcd-dda5-404b-a812-7c6ea45630b7 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.479677 Jun 27 18:37:29.856995 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1291 bytes} [Mon Jun 27 18:37:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:37:31.981490 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-ebfb1dff-a9a0-4709-a7b5-3c524ab9f58c None None] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:37:31.982520 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-ebfb1dff-a9a0-4709-a7b5-3c524ab9f58c None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jun 27 18:37:31.982916 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 3/4] 10.222.0.15 () {54 vars in 930 bytes} [Mon Jun 27 18:37:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:37:32.042928 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-dc395030-fb12-4e05-8068-a650340627a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "cirros256", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1, "id": "c1"}} {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:37:32.061669 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 18:37:32.061669 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: warnings.warn(msg) Jun 27 18:37:32.152267 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-dc395030-fb12-4e05-8068-a650340627a3 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.161889 Jun 27 18:37:32.153075 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 2/5] 10.222.0.15 () {64 vars in 1282 bytes} [Mon Jun 27 18:37:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 18:37:32.168732 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG dbcounter [-] [110198] Writing DB stats nova_api:SELECT=3 {{(pid=110198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:37:32.170238 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG dbcounter [-] [110198] Writing DB stats nova_cell1:SELECT=3 {{(pid=110198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:37:32.171228 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG dbcounter [-] [110198] Writing DB stats nova_cell0:SELECT=3 {{(pid=110198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:37:32.172167 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG dbcounter [-] [110198] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:37:32.380573 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-cf99214a-b3cc-4cd3-be48-f628f79a10cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:37:32.382927 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 18:37:32.382927 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: warnings.warn(msg) Jun 27 18:37:32.502157 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-cf99214a-b3cc-4cd3-be48-f628f79a10cd admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.340113 Jun 27 18:37:32.506592 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 4/6] 10.222.0.15 () {64 vars in 1335 bytes} [Mon Jun 27 18:37:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:37:34.666870 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-dc395030-fb12-4e05-8068-a650340627a3 admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:37:34.667946 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-dc395030-fb12-4e05-8068-a650340627a3 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jun 27 18:37:34.668440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 3/7] 10.222.0.15 () {54 vars in 930 bytes} [Mon Jun 27 18:37:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:37:34.786085 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-18b8bc83-69e6-4aea-910f-39973bbe8e9b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "name": "ds512M", "swap": 0, "disk": 5, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512}} {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:37:34.804121 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 18:37:34.804121 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: warnings.warn(msg) Jun 27 18:37:34.925509 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-18b8bc83-69e6-4aea-910f-39973bbe8e9b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.251077 Jun 27 18:37:34.926648 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 5/8] 10.222.0.15 () {64 vars in 1282 bytes} [Mon Jun 27 18:37:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 18:37:34.948940 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-3a8ea820-1011-4072-9b55-a903323f4317 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:37:34.951513 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 18:37:34.951513 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: warnings.warn(msg) Jun 27 18:37:35.065810 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-3a8ea820-1011-4072-9b55-a903323f4317 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120436 Jun 27 18:37:35.066345 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 4/9] 10.222.0.15 () {64 vars in 1335 bytes} [Mon Jun 27 18:37:34 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:37:37.174745 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-18b8bc83-69e6-4aea-910f-39973bbe8e9b admin admin] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:37:37.175771 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-18b8bc83-69e6-4aea-910f-39973bbe8e9b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jun 27 18:37:37.176346 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 930 bytes} [Mon Jun 27 18:37:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:37:37.235241 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-95d569f5-fe2b-4ed5-a273-5d75bead764e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "os-flavor-access:is_public": true, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024, "vcpus": 1, "id": "d2"}} {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:37:37.315927 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-95d569f5-fe2b-4ed5-a273-5d75bead764e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.133901 Jun 27 18:37:37.316586 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 5/11] 10.222.0.15 () {64 vars in 1282 bytes} [Mon Jun 27 18:37:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 18:37:37.329115 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-3947b067-3beb-4c39-86fc-fb7dc8bb4565 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:37:37.411520 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-3947b067-3beb-4c39-86fc-fb7dc8bb4565 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086087 Jun 27 18:37:37.412273 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 7/12] 10.222.0.15 () {64 vars in 1335 bytes} [Mon Jun 27 18:37:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:37:39.508425 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-95d569f5-fe2b-4ed5-a273-5d75bead764e admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:37:39.509471 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-95d569f5-fe2b-4ed5-a273-5d75bead764e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 27 18:37:39.509873 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 6/13] 10.222.0.15 () {54 vars in 930 bytes} [Mon Jun 27 18:37:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:37:39.569028 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-cc69e6e7-a2c2-4a64-be83-1a29f069f82d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 2, "os-flavor-access:is_public": true, "id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 10}} {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:37:39.646285 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-cc69e6e7-a2c2-4a64-be83-1a29f069f82d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.130525 Jun 27 18:37:39.646868 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 8/14] 10.222.0.15 () {64 vars in 1282 bytes} [Mon Jun 27 18:37:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 18:37:39.659011 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-935a09a2-f016-4898-98f2-79b676166215 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:37:39.771077 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-935a09a2-f016-4898-98f2-79b676166215 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116050 Jun 27 18:37:39.771682 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 7/15] 10.222.0.15 () {64 vars in 1335 bytes} [Mon Jun 27 18:37:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:37:41.876408 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-cc69e6e7-a2c2-4a64-be83-1a29f069f82d admin admin] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:37:41.878051 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-cc69e6e7-a2c2-4a64-be83-1a29f069f82d admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002063 Jun 27 18:37:41.880478 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 9/16] 10.222.0.15 () {54 vars in 930 bytes} [Mon Jun 27 18:37:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:37:41.940585 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-3c697647-d67c-4911-8cfa-0203ce9d7d58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "id": "d4", "swap": 0, "name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:37:42.035663 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-3c697647-d67c-4911-8cfa-0203ce9d7d58 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.148741 Jun 27 18:37:42.036493 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 8/17] 10.222.0.15 () {64 vars in 1282 bytes} [Mon Jun 27 18:37:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 18:37:42.048265 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-735a15d5-f840-4a3f-9c6d-2d1488ce7d93 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:37:42.140487 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-735a15d5-f840-4a3f-9c6d-2d1488ce7d93 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095856 Jun 27 18:37:42.141062 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 10/18] 10.222.0.15 () {64 vars in 1335 bytes} [Mon Jun 27 18:37:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:37:44.263805 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-3c697647-d67c-4911-8cfa-0203ce9d7d58 admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:37:44.265248 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-3c697647-d67c-4911-8cfa-0203ce9d7d58 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001918 Jun 27 18:37:44.265809 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 9/19] 10.222.0.15 () {54 vars in 930 bytes} [Mon Jun 27 18:37:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:37:44.329856 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-b6a9f7af-3fc2-4b7c-9fdb-8e3b2f72b87e admin admin] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:37:44.356968 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-b6a9f7af-3fc2-4b7c-9fdb-8e3b2f72b87e admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085163 Jun 27 18:37:44.357558 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1291 bytes} [Mon Jun 27 18:37:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:37:46.493128 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-3c697647-d67c-4911-8cfa-0203ce9d7d58 admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:37:46.494210 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-3c697647-d67c-4911-8cfa-0203ce9d7d58 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 27 18:37:46.494645 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 930 bytes} [Mon Jun 27 18:37:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:37:46.567301 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-fc32938a-80d7-463d-a24c-a9771f503b43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 512, "name": "m1.tiny", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1"}} {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:37:46.636549 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-fc32938a-80d7-463d-a24c-a9771f503b43 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.135919 Jun 27 18:37:46.637219 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 12/22] 10.222.0.15 () {64 vars in 1282 bytes} [Mon Jun 27 18:37:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 18:37:46.649944 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-48d3d048-f463-4d85-9f81-6155c872b2e2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:37:46.729971 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-48d3d048-f463-4d85-9f81-6155c872b2e2 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083905 Jun 27 18:37:46.730491 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 11/23] 10.222.0.15 () {64 vars in 1332 bytes} [Mon Jun 27 18:37:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:37:48.805904 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-fc32938a-80d7-463d-a24c-a9771f503b43 admin admin] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:37:48.807252 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-fc32938a-80d7-463d-a24c-a9771f503b43 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001937 Jun 27 18:37:48.807801 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 930 bytes} [Mon Jun 27 18:37:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:37:48.870436 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-54d82af0-ee13-4ea8-a639-c6d40be1ba49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "id": "2", "rxtx_factor": 1.0, "name": "m1.small", "swap": 0, "ram": 2048, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:37:48.953081 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-54d82af0-ee13-4ea8-a639-c6d40be1ba49 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.137616 Jun 27 18:37:48.953776 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 12/25] 10.222.0.15 () {64 vars in 1282 bytes} [Mon Jun 27 18:37:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 18:37:48.966273 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-bb35c2bb-1ef6-4ca3-b25d-c14f9f8b9e80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:37:49.061007 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-bb35c2bb-1ef6-4ca3-b25d-c14f9f8b9e80 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098489 Jun 27 18:37:49.061937 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 14/26] 10.222.0.15 () {64 vars in 1332 bytes} [Mon Jun 27 18:37:48 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:37:51.190012 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-54d82af0-ee13-4ea8-a639-c6d40be1ba49 admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:37:51.191359 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-54d82af0-ee13-4ea8-a639-c6d40be1ba49 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002462 Jun 27 18:37:51.191854 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 930 bytes} [Mon Jun 27 18:37:51 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:37:51.251844 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-b72685fc-b29c-4458-9919-85da7efe91cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "vcpus": 2, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 40}} {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:37:51.359220 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-b72685fc-b29c-4458-9919-85da7efe91cd admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.161494 Jun 27 18:37:51.359785 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 15/28] 10.222.0.15 () {64 vars in 1282 bytes} [Mon Jun 27 18:37:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 18:37:51.372596 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-a539df19-1484-4226-8039-9bdb42e2eb96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:37:51.473716 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-a539df19-1484-4226-8039-9bdb42e2eb96 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104789 Jun 27 18:37:51.474769 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 14/29] 10.222.0.15 () {64 vars in 1332 bytes} [Mon Jun 27 18:37:51 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:37:53.552756 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-b72685fc-b29c-4458-9919-85da7efe91cd admin admin] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:37:53.554051 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-b72685fc-b29c-4458-9919-85da7efe91cd admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001718 Jun 27 18:37:53.554567 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 930 bytes} [Mon Jun 27 18:37:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:37:53.615753 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-25b1356e-b376-4e4e-b996-c0cbb051189a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "os-flavor-access:is_public": true, "name": "m1.large", "id": "4"}} {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:37:53.697837 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-25b1356e-b376-4e4e-b996-c0cbb051189a admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.137323 Jun 27 18:37:53.698496 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 15/31] 10.222.0.15 () {64 vars in 1282 bytes} [Mon Jun 27 18:37:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 18:37:53.711854 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-fa76b7e7-7a55-4164-8893-344a4b25b171 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:37:53.792253 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-fa76b7e7-7a55-4164-8893-344a4b25b171 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084890 Jun 27 18:37:53.792996 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1332 bytes} [Mon Jun 27 18:37:53 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:37:55.918637 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-25b1356e-b376-4e4e-b996-c0cbb051189a admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:37:55.919654 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-25b1356e-b376-4e4e-b996-c0cbb051189a admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jun 27 18:37:55.920052 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 930 bytes} [Mon Jun 27 18:37:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:37:55.995290 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-963d3858-1dfa-424a-b6d7-44969769aa3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "swap": 0, "ram": 16384, "rxtx_factor": 1.0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "os-flavor-access:is_public": true}} {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:37:56.323707 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-963d3858-1dfa-424a-b6d7-44969769aa3e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.396928 Jun 27 18:37:56.324609 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 18/34] 10.222.0.15 () {64 vars in 1282 bytes} [Mon Jun 27 18:37:55 2022] POST /compute/v2.1/flavors => generated 408 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 18:37:56.337349 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-ca020875-5000-4e51-89d4-71798974a470 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:37:56.430288 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-ca020875-5000-4e51-89d4-71798974a470 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096580 Jun 27 18:37:56.430848 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 17/35] 10.222.0.15 () {64 vars in 1332 bytes} [Mon Jun 27 18:37:56 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:38:20.984011 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-963d3858-1dfa-424a-b6d7-44969769aa3e admin admin] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:38:20.985944 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-963d3858-1dfa-424a-b6d7-44969769aa3e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jun 27 18:38:20.986339 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 930 bytes} [Mon Jun 27 18:38:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:38:20.996970 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG dbcounter [-] [110199] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=110199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:38:21.044245 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-bc97a349-ef50-4747-b7e2-dad56ebe0dd3 admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:38:21.061400 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-bc97a349-ef50-4747-b7e2-dad56ebe0dd3 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069112 Jun 27 18:38:21.061931 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1291 bytes} [Mon Jun 27 18:38:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:38:21.977506 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-963d3858-1dfa-424a-b6d7-44969769aa3e admin admin] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:38:21.978583 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-963d3858-1dfa-424a-b6d7-44969769aa3e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 27 18:38:21.978986 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Jun 27 18:38:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:38:22.168971 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-a342ebe5-02f3-4eed-af56-1abe902dc25a admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:38:22.174510 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.wsgi [None req-a342ebe5-02f3-4eed-af56-1abe902dc25a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 27 18:38:22.177735 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-a342ebe5-02f3-4eed-af56-1abe902dc25a admin admin] Request method failure captured: Jun 27 18:38:22.177735 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 27 18:38:22.177735 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: Accept: application/json Jun 27 18:38:22.177735 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: Accept-Encoding: gzip, deflate Jun 27 18:38:22.177735 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: Connection: keep-alive Jun 27 18:38:22.177735 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: Content-Length: 0 Jun 27 18:38:22.177735 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: Host: 10.222.0.15 Jun 27 18:38:22.177735 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: Openstack-Api-Version: compute 2.90 Jun 27 18:38:22.177735 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: Openstack-System-Scope: None Jun 27 18:38:22.177735 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: User-Agent: python-novaclient Jun 27 18:38:22.177735 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Auth-Token: gAAAAABiufkdnePxja5IOvqJeUBLF71dzDTk0golie5btmD7WS-8aiS-bJq5NsZl2g2auceuu8Hi4H7X7LN37-jsZHs1MT1uS8XDpjln6IZTfr5gOyyXkoFQzev5hrWigbOmA4EQHj1IU7kl-ALvZAexXHR8R4xQXtmtkEuGFqrVLX24Rdo28nE Jun 27 18:38:22.177735 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Domain-Id: None Jun 27 18:38:22.177735 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Domain-Name: None Jun 27 18:38:22.177735 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Identity-Status: Confirmed Jun 27 18:38:22.177735 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Is-Admin-Project: True Jun 27 18:38:22.177735 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 18:38:22.177735 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Project-Domain-Id: default Jun 27 18:38:22.177735 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Project-Domain-Name: Default Jun 27 18:38:22.177735 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Project-Id: d9ffe361a6094e199bb35c633199d02f Jun 27 18:38:22.177735 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Project-Name: admin Jun 27 18:38:22.177735 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Role: reader,admin,member Jun 27 18:38:22.177735 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Roles: reader,admin,member Jun 27 18:38:22.179435 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d9ffe361a6094e199bb35c633199d02f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d9ffe361a6094e199bb35c633199d02f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d9ffe361a6094e199bb35c633199d02f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d9ffe361a6094e199bb35c633199d02f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:38:22.179435 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Tenant: admin Jun 27 18:38:22.179435 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Tenant-Id: d9ffe361a6094e199bb35c633199d02f Jun 27 18:38:22.179435 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Tenant-Name: admin Jun 27 18:38:22.179435 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-User: admin Jun 27 18:38:22.179435 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-User-Domain-Id: default Jun 27 18:38:22.179435 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-User-Domain-Name: Default Jun 27 18:38:22.179435 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-User-Id: 3d0ddf436e7443679ab397306fca9e90 Jun 27 18:38:22.179435 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-User-Name: admin Jun 27 18:38:22.179435 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: method: > Jun 27 18:38:22.179435 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: exception: Flavor 42 could not be found. Jun 27 18:38:22.179435 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: action_args: {'id': '42'} Jun 27 18:38:22.179435 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:38:22.179435 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:38:22.180499 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 18:38:22.180499 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 18:38:22.180499 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 18:38:22.180499 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 18:38:22.180499 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 18:38:22.180499 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 18:38:22.180499 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 18:38:22.180499 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 18:38:22.180499 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 18:38:22.180499 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:38:22.180499 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 18:38:22.180499 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 18:38:22.180499 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 27 18:38:22.180499 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi Jun 27 18:38:22.180499 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:38:22.180499 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi Jun 27 18:38:22.180499 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:38:22.180499 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:38:22.180499 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:38:22.181982 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:38:22.181982 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:38:22.181982 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:38:22.181982 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:38:22.181982 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 18:38:22.181982 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:38:22.181982 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 27 18:38:22.181982 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi Jun 27 18:38:22.181982 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:38:22.181982 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi Jun 27 18:38:22.181982 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:38:22.181982 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:38:22.181982 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:38:22.181982 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:38:22.181982 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:38:22.181982 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 27 18:38:22.181982 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi Jun 27 18:38:22.181982 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-a342ebe5-02f3-4eed-af56-1abe902dc25a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:38:22.183293 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-a342ebe5-02f3-4eed-af56-1abe902dc25a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062281 Jun 27 18:38:22.183293 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Jun 27 18:38:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 18:38:22.189330 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-194300d0-3a6a-45d1-a4bc-fd02a320b2ba admin admin] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:38:22.192623 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG dbcounter [-] [110198] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:38:22.211561 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-194300d0-3a6a-45d1-a4bc-fd02a320b2ba admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026255 Jun 27 18:38:22.212113 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 21/40] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Jun 27 18:38:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:38:22.222340 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-64518b22-2546-4cca-967d-13d7ad505a0a admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:38:22.244100 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-64518b22-2546-4cca-967d-13d7ad505a0a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025923 Jun 27 18:38:22.244626 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Jun 27 18:38:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:38:22.254692 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-fe778569-c03b-444d-a82e-93ec01750ff2 admin admin] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:38:22.260300 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.wsgi [None req-fe778569-c03b-444d-a82e-93ec01750ff2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 27 18:38:22.263558 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-fe778569-c03b-444d-a82e-93ec01750ff2 admin admin] Request method failure captured: Jun 27 18:38:22.263558 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 27 18:38:22.263558 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: Accept: application/json Jun 27 18:38:22.263558 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: Accept-Encoding: gzip, deflate Jun 27 18:38:22.263558 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: Connection: keep-alive Jun 27 18:38:22.263558 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: Content-Length: 0 Jun 27 18:38:22.263558 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: Host: 10.222.0.15 Jun 27 18:38:22.263558 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: Openstack-Api-Version: compute 2.90 Jun 27 18:38:22.263558 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: Openstack-System-Scope: None Jun 27 18:38:22.263558 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: User-Agent: python-novaclient Jun 27 18:38:22.263558 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Auth-Token: gAAAAABiufkdnePxja5IOvqJeUBLF71dzDTk0golie5btmD7WS-8aiS-bJq5NsZl2g2auceuu8Hi4H7X7LN37-jsZHs1MT1uS8XDpjln6IZTfr5gOyyXkoFQzev5hrWigbOmA4EQHj1IU7kl-ALvZAexXHR8R4xQXtmtkEuGFqrVLX24Rdo28nE Jun 27 18:38:22.263558 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Domain-Id: None Jun 27 18:38:22.263558 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Domain-Name: None Jun 27 18:38:22.263558 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Identity-Status: Confirmed Jun 27 18:38:22.263558 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Is-Admin-Project: True Jun 27 18:38:22.263558 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 18:38:22.263558 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Project-Domain-Id: default Jun 27 18:38:22.263558 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Project-Domain-Name: Default Jun 27 18:38:22.263558 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Project-Id: d9ffe361a6094e199bb35c633199d02f Jun 27 18:38:22.263558 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Project-Name: admin Jun 27 18:38:22.263558 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Role: reader,admin,member Jun 27 18:38:22.263558 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Roles: reader,admin,member Jun 27 18:38:22.268072 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d9ffe361a6094e199bb35c633199d02f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d9ffe361a6094e199bb35c633199d02f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d9ffe361a6094e199bb35c633199d02f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d9ffe361a6094e199bb35c633199d02f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:38:22.268072 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Tenant: admin Jun 27 18:38:22.268072 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Tenant-Id: d9ffe361a6094e199bb35c633199d02f Jun 27 18:38:22.268072 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Tenant-Name: admin Jun 27 18:38:22.268072 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-User: admin Jun 27 18:38:22.268072 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-User-Domain-Id: default Jun 27 18:38:22.268072 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-User-Domain-Name: Default Jun 27 18:38:22.268072 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-User-Id: 3d0ddf436e7443679ab397306fca9e90 Jun 27 18:38:22.268072 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-User-Name: admin Jun 27 18:38:22.268072 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: method: > Jun 27 18:38:22.268072 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: exception: Flavor 42 could not be found. Jun 27 18:38:22.268072 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: action_args: {'id': '42'} Jun 27 18:38:22.268072 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:38:22.268072 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:38:22.268959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 18:38:22.268959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 18:38:22.268959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 18:38:22.268959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 18:38:22.268959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 18:38:22.268959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 18:38:22.268959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 18:38:22.268959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 18:38:22.268959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 18:38:22.268959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:38:22.268959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 18:38:22.268959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 18:38:22.268959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 27 18:38:22.268959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi Jun 27 18:38:22.268959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:38:22.268959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi Jun 27 18:38:22.268959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:38:22.268959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:38:22.268959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:38:22.270016 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:38:22.270016 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:38:22.270016 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:38:22.270016 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:38:22.270016 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 18:38:22.270016 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:38:22.270016 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 27 18:38:22.270016 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi Jun 27 18:38:22.270016 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:38:22.270016 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi Jun 27 18:38:22.270016 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:38:22.270016 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:38:22.270016 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:38:22.270016 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:38:22.270016 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:38:22.270016 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 27 18:38:22.270016 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi Jun 27 18:38:22.270016 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-fe778569-c03b-444d-a82e-93ec01750ff2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:38:22.271062 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-fe778569-c03b-444d-a82e-93ec01750ff2 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014813 Jun 27 18:38:22.271062 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Jun 27 18:38:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 18:38:23.081741 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-64518b22-2546-4cca-967d-13d7ad505a0a admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:38:23.082801 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-64518b22-2546-4cca-967d-13d7ad505a0a admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 27 18:38:23.083207 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Jun 27 18:38:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:38:23.273202 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-0c0b24a6-d11d-4fdf-86c8-11274f0c2d83 admin admin] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:38:23.279019 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.wsgi [None req-0c0b24a6-d11d-4fdf-86c8-11274f0c2d83 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 27 18:38:23.280531 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-0c0b24a6-d11d-4fdf-86c8-11274f0c2d83 admin admin] Request method failure captured: Jun 27 18:38:23.280531 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 27 18:38:23.280531 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: Accept: application/json Jun 27 18:38:23.280531 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: Accept-Encoding: gzip, deflate Jun 27 18:38:23.280531 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: Connection: keep-alive Jun 27 18:38:23.280531 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: Content-Length: 0 Jun 27 18:38:23.280531 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: Host: 10.222.0.15 Jun 27 18:38:23.280531 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: Openstack-Api-Version: compute 2.90 Jun 27 18:38:23.280531 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: Openstack-System-Scope: None Jun 27 18:38:23.280531 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: User-Agent: python-novaclient Jun 27 18:38:23.280531 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Auth-Token: gAAAAABiufkfe7h5TDI00ZvmNKEC6XY5-M0Lq-3XiFMxMfUFXwoBUMF90tXU20-O4igKnarjNhBvP9U49HP6OlSBGGTE2y1erXzTtseIRPS7qkPy0uBm9uNwAEkFXak6Y6Dcb6GeKimLO9-qlsyiq8_rxnu_ifSYKiubk_yc_traXvS8yRg8lhQ Jun 27 18:38:23.280531 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Domain-Id: None Jun 27 18:38:23.280531 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Domain-Name: None Jun 27 18:38:23.280531 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Identity-Status: Confirmed Jun 27 18:38:23.280531 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Is-Admin-Project: True Jun 27 18:38:23.280531 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 18:38:23.280531 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Project-Domain-Id: default Jun 27 18:38:23.280531 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Project-Domain-Name: Default Jun 27 18:38:23.280531 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Project-Id: d9ffe361a6094e199bb35c633199d02f Jun 27 18:38:23.280531 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Project-Name: admin Jun 27 18:38:23.280531 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Role: reader,admin,member Jun 27 18:38:23.280531 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Roles: reader,admin,member Jun 27 18:38:23.281981 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d9ffe361a6094e199bb35c633199d02f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d9ffe361a6094e199bb35c633199d02f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d9ffe361a6094e199bb35c633199d02f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d9ffe361a6094e199bb35c633199d02f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:38:23.281981 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Tenant: admin Jun 27 18:38:23.281981 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Tenant-Id: d9ffe361a6094e199bb35c633199d02f Jun 27 18:38:23.281981 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Tenant-Name: admin Jun 27 18:38:23.281981 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-User: admin Jun 27 18:38:23.281981 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-User-Domain-Id: default Jun 27 18:38:23.281981 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-User-Domain-Name: Default Jun 27 18:38:23.281981 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-User-Id: 3d0ddf436e7443679ab397306fca9e90 Jun 27 18:38:23.281981 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-User-Name: admin Jun 27 18:38:23.281981 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: method: > Jun 27 18:38:23.281981 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: exception: Flavor 84 could not be found. Jun 27 18:38:23.281981 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: action_args: {'id': '84'} Jun 27 18:38:23.281981 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:38:23.281981 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:38:23.282853 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 18:38:23.282853 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 18:38:23.282853 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 18:38:23.282853 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 18:38:23.282853 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 18:38:23.282853 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 18:38:23.282853 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 18:38:23.282853 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 18:38:23.282853 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 18:38:23.282853 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:38:23.282853 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 18:38:23.282853 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 18:38:23.282853 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 27 18:38:23.282853 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi Jun 27 18:38:23.282853 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:38:23.282853 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi Jun 27 18:38:23.282853 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:38:23.282853 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:38:23.282853 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:38:23.284206 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:38:23.284206 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:38:23.284206 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:38:23.284206 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:38:23.284206 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 18:38:23.284206 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:38:23.284206 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 27 18:38:23.284206 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi Jun 27 18:38:23.284206 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:38:23.284206 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi Jun 27 18:38:23.284206 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:38:23.284206 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:38:23.284206 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:38:23.284206 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:38:23.284206 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:38:23.284206 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 27 18:38:23.284206 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi Jun 27 18:38:23.284206 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-0c0b24a6-d11d-4fdf-86c8-11274f0c2d83 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:38:23.285565 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-0c0b24a6-d11d-4fdf-86c8-11274f0c2d83 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060620 Jun 27 18:38:23.285565 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Jun 27 18:38:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 18:38:23.291811 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-007fd3ac-d5b7-4910-83ec-6efa90668b49 admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:38:23.305565 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-007fd3ac-d5b7-4910-83ec-6efa90668b49 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017514 Jun 27 18:38:23.306089 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Jun 27 18:38:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:38:23.316311 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-136d7908-2c1d-4239-98a6-9e8f92f480b6 admin admin] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:38:23.329656 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-136d7908-2c1d-4239-98a6-9e8f92f480b6 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017919 Jun 27 18:38:23.330176 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Jun 27 18:38:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:38:23.338955 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-8e9cf95c-c8df-4644-a1b2-81265be1c230 admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:38:23.344267 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.wsgi [None req-8e9cf95c-c8df-4644-a1b2-81265be1c230 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 27 18:38:23.345751 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-8e9cf95c-c8df-4644-a1b2-81265be1c230 admin admin] Request method failure captured: Jun 27 18:38:23.345751 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 27 18:38:23.345751 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: Accept: application/json Jun 27 18:38:23.345751 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: Accept-Encoding: gzip, deflate Jun 27 18:38:23.345751 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: Connection: keep-alive Jun 27 18:38:23.345751 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: Content-Length: 0 Jun 27 18:38:23.345751 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: Host: 10.222.0.15 Jun 27 18:38:23.345751 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: Openstack-Api-Version: compute 2.90 Jun 27 18:38:23.345751 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: Openstack-System-Scope: None Jun 27 18:38:23.345751 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: User-Agent: python-novaclient Jun 27 18:38:23.345751 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Auth-Token: gAAAAABiufkfe7h5TDI00ZvmNKEC6XY5-M0Lq-3XiFMxMfUFXwoBUMF90tXU20-O4igKnarjNhBvP9U49HP6OlSBGGTE2y1erXzTtseIRPS7qkPy0uBm9uNwAEkFXak6Y6Dcb6GeKimLO9-qlsyiq8_rxnu_ifSYKiubk_yc_traXvS8yRg8lhQ Jun 27 18:38:23.345751 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Domain-Id: None Jun 27 18:38:23.345751 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Domain-Name: None Jun 27 18:38:23.345751 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Identity-Status: Confirmed Jun 27 18:38:23.345751 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Is-Admin-Project: True Jun 27 18:38:23.345751 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 18:38:23.345751 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Project-Domain-Id: default Jun 27 18:38:23.345751 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Project-Domain-Name: Default Jun 27 18:38:23.345751 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Project-Id: d9ffe361a6094e199bb35c633199d02f Jun 27 18:38:23.345751 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Project-Name: admin Jun 27 18:38:23.345751 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Role: reader,admin,member Jun 27 18:38:23.345751 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Roles: reader,admin,member Jun 27 18:38:23.347373 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d9ffe361a6094e199bb35c633199d02f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d9ffe361a6094e199bb35c633199d02f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d9ffe361a6094e199bb35c633199d02f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d9ffe361a6094e199bb35c633199d02f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:38:23.347373 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Tenant: admin Jun 27 18:38:23.347373 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Tenant-Id: d9ffe361a6094e199bb35c633199d02f Jun 27 18:38:23.347373 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Tenant-Name: admin Jun 27 18:38:23.347373 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-User: admin Jun 27 18:38:23.347373 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-User-Domain-Id: default Jun 27 18:38:23.347373 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-User-Domain-Name: Default Jun 27 18:38:23.347373 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-User-Id: 3d0ddf436e7443679ab397306fca9e90 Jun 27 18:38:23.347373 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-User-Name: admin Jun 27 18:38:23.347373 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: method: > Jun 27 18:38:23.347373 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: exception: Flavor 84 could not be found. Jun 27 18:38:23.347373 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: action_args: {'id': '84'} Jun 27 18:38:23.347373 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:38:23.347373 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:38:23.348495 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 18:38:23.348495 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 18:38:23.348495 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 18:38:23.348495 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 18:38:23.348495 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 18:38:23.348495 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 18:38:23.348495 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 18:38:23.348495 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 18:38:23.348495 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 18:38:23.348495 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:38:23.348495 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 18:38:23.348495 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 18:38:23.348495 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 27 18:38:23.348495 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi Jun 27 18:38:23.348495 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:38:23.348495 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi Jun 27 18:38:23.348495 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:38:23.348495 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:38:23.348495 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:38:23.349814 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:38:23.349814 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:38:23.349814 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:38:23.349814 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:38:23.349814 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 18:38:23.349814 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:38:23.349814 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 27 18:38:23.349814 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi Jun 27 18:38:23.349814 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:38:23.349814 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi Jun 27 18:38:23.349814 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:38:23.349814 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:38:23.349814 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:38:23.349814 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:38:23.349814 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:38:23.349814 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 27 18:38:23.349814 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi Jun 27 18:38:23.349814 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-8e9cf95c-c8df-4644-a1b2-81265be1c230 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:38:23.351219 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-8e9cf95c-c8df-4644-a1b2-81265be1c230 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011595 Jun 27 18:38:23.351219 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Jun 27 18:38:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 18:38:24.163748 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-136d7908-2c1d-4239-98a6-9e8f92f480b6 admin admin] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:38:24.164752 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-136d7908-2c1d-4239-98a6-9e8f92f480b6 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jun 27 18:38:24.165150 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 25/48] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Jun 27 18:38:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:38:24.356622 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-ddafaed3-9bd2-4fc8-834d-337c4c490040 admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:38:24.362666 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.wsgi [None req-ddafaed3-9bd2-4fc8-834d-337c4c490040 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 27 18:38:24.364440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-ddafaed3-9bd2-4fc8-834d-337c4c490040 admin admin] Request method failure captured: Jun 27 18:38:24.364440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 27 18:38:24.364440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: Accept: application/json Jun 27 18:38:24.364440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: Accept-Encoding: gzip, deflate Jun 27 18:38:24.364440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: Connection: keep-alive Jun 27 18:38:24.364440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: Content-Length: 0 Jun 27 18:38:24.364440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: Host: 10.222.0.15 Jun 27 18:38:24.364440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: Openstack-Api-Version: compute 2.90 Jun 27 18:38:24.364440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: Openstack-System-Scope: None Jun 27 18:38:24.364440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: User-Agent: python-novaclient Jun 27 18:38:24.364440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Auth-Token: gAAAAABiufkgwHCFNTIGqvGbGNxMEsY0sK08UKVYFav-qlYZ90QHayhkLOQuny1bmBHfGYP-yHiyT50pX-uqIp2LuBPDVr8jjjtd7ePjzVc4lwd9ioRHDl8vMJHUTh2Ds6wz6CuImw9poaCR3MlybBoN4vwhibcGl2sKgDdJqkBAKgKYbAsQJpQ Jun 27 18:38:24.364440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Domain-Id: None Jun 27 18:38:24.364440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Domain-Name: None Jun 27 18:38:24.364440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Identity-Status: Confirmed Jun 27 18:38:24.364440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Is-Admin-Project: True Jun 27 18:38:24.364440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 18:38:24.364440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Project-Domain-Id: default Jun 27 18:38:24.364440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Project-Domain-Name: Default Jun 27 18:38:24.364440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Project-Id: d9ffe361a6094e199bb35c633199d02f Jun 27 18:38:24.364440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Project-Name: admin Jun 27 18:38:24.364440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Role: reader,admin,member Jun 27 18:38:24.364440 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Roles: reader,admin,member Jun 27 18:38:24.365827 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d9ffe361a6094e199bb35c633199d02f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d9ffe361a6094e199bb35c633199d02f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d9ffe361a6094e199bb35c633199d02f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d9ffe361a6094e199bb35c633199d02f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:38:24.365827 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Tenant: admin Jun 27 18:38:24.365827 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Tenant-Id: d9ffe361a6094e199bb35c633199d02f Jun 27 18:38:24.365827 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-Tenant-Name: admin Jun 27 18:38:24.365827 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-User: admin Jun 27 18:38:24.365827 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-User-Domain-Id: default Jun 27 18:38:24.365827 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-User-Domain-Name: Default Jun 27 18:38:24.365827 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-User-Id: 3d0ddf436e7443679ab397306fca9e90 Jun 27 18:38:24.365827 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: X-User-Name: admin Jun 27 18:38:24.365827 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: method: > Jun 27 18:38:24.365827 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: exception: Flavor 451 could not be found. Jun 27 18:38:24.365827 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: action_args: {'id': '451'} Jun 27 18:38:24.365827 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:38:24.365827 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:38:24.366689 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 18:38:24.366689 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 18:38:24.366689 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 18:38:24.366689 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 18:38:24.366689 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 18:38:24.366689 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 18:38:24.366689 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 18:38:24.366689 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 18:38:24.366689 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 18:38:24.366689 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:38:24.366689 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 18:38:24.366689 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 18:38:24.366689 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 27 18:38:24.366689 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi Jun 27 18:38:24.366689 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:38:24.366689 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi Jun 27 18:38:24.366689 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:38:24.366689 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:38:24.366689 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:38:24.367741 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:38:24.367741 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:38:24.367741 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:38:24.367741 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:38:24.367741 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 18:38:24.367741 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:38:24.367741 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 27 18:38:24.367741 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi Jun 27 18:38:24.367741 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:38:24.367741 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi Jun 27 18:38:24.367741 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:38:24.367741 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:38:24.367741 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:38:24.367741 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:38:24.367741 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:38:24.367741 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 27 18:38:24.367741 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: ERROR nova.api.openstack.wsgi Jun 27 18:38:24.367741 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-ddafaed3-9bd2-4fc8-834d-337c4c490040 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:38:24.368790 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-ddafaed3-9bd2-4fc8-834d-337c4c490040 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061135 Jun 27 18:38:24.368790 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Jun 27 18:38:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 18:38:24.383030 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-19f90f49-af8a-494d-beed-581c584fecad admin admin] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:38:24.389511 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-19f90f49-af8a-494d-beed-581c584fecad admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017709 Jun 27 18:38:24.390020 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Jun 27 18:38:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:38:24.400056 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-44e2109a-49a0-41ec-a79c-1881ae4ab365 admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:38:24.414613 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-44e2109a-49a0-41ec-a79c-1881ae4ab365 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018016 Jun 27 18:38:24.415138 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Jun 27 18:38:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:38:24.424184 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-968033c7-eef6-4b00-8c05-0c20d6554a4e admin admin] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:38:24.429469 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.wsgi [None req-968033c7-eef6-4b00-8c05-0c20d6554a4e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 27 18:38:24.431005 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-968033c7-eef6-4b00-8c05-0c20d6554a4e admin admin] Request method failure captured: Jun 27 18:38:24.431005 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 27 18:38:24.431005 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: Accept: application/json Jun 27 18:38:24.431005 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: Accept-Encoding: gzip, deflate Jun 27 18:38:24.431005 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: Connection: keep-alive Jun 27 18:38:24.431005 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: Content-Length: 0 Jun 27 18:38:24.431005 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: Host: 10.222.0.15 Jun 27 18:38:24.431005 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: Openstack-Api-Version: compute 2.90 Jun 27 18:38:24.431005 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: Openstack-System-Scope: None Jun 27 18:38:24.431005 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: User-Agent: python-novaclient Jun 27 18:38:24.431005 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Auth-Token: gAAAAABiufkgwHCFNTIGqvGbGNxMEsY0sK08UKVYFav-qlYZ90QHayhkLOQuny1bmBHfGYP-yHiyT50pX-uqIp2LuBPDVr8jjjtd7ePjzVc4lwd9ioRHDl8vMJHUTh2Ds6wz6CuImw9poaCR3MlybBoN4vwhibcGl2sKgDdJqkBAKgKYbAsQJpQ Jun 27 18:38:24.431005 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Domain-Id: None Jun 27 18:38:24.431005 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Domain-Name: None Jun 27 18:38:24.431005 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Identity-Status: Confirmed Jun 27 18:38:24.431005 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Is-Admin-Project: True Jun 27 18:38:24.431005 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 18:38:24.431005 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Project-Domain-Id: default Jun 27 18:38:24.431005 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Project-Domain-Name: Default Jun 27 18:38:24.431005 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Project-Id: d9ffe361a6094e199bb35c633199d02f Jun 27 18:38:24.431005 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Project-Name: admin Jun 27 18:38:24.431005 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Role: reader,admin,member Jun 27 18:38:24.431005 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Roles: reader,admin,member Jun 27 18:38:24.432526 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d9ffe361a6094e199bb35c633199d02f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d9ffe361a6094e199bb35c633199d02f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d9ffe361a6094e199bb35c633199d02f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d9ffe361a6094e199bb35c633199d02f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:38:24.432526 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Tenant: admin Jun 27 18:38:24.432526 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Tenant-Id: d9ffe361a6094e199bb35c633199d02f Jun 27 18:38:24.432526 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-Tenant-Name: admin Jun 27 18:38:24.432526 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-User: admin Jun 27 18:38:24.432526 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-User-Domain-Id: default Jun 27 18:38:24.432526 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-User-Domain-Name: Default Jun 27 18:38:24.432526 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-User-Id: 3d0ddf436e7443679ab397306fca9e90 Jun 27 18:38:24.432526 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: X-User-Name: admin Jun 27 18:38:24.432526 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: method: > Jun 27 18:38:24.432526 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: exception: Flavor 451 could not be found. Jun 27 18:38:24.432526 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: action_args: {'id': '451'} Jun 27 18:38:24.432526 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:38:24.432526 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:38:24.433459 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 18:38:24.433459 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 18:38:24.433459 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 18:38:24.433459 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 18:38:24.433459 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 18:38:24.433459 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 18:38:24.433459 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 18:38:24.433459 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 18:38:24.433459 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 18:38:24.433459 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:38:24.433459 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 18:38:24.433459 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 18:38:24.433459 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 27 18:38:24.433459 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi Jun 27 18:38:24.433459 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:38:24.433459 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi Jun 27 18:38:24.433459 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:38:24.433459 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:38:24.433459 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:38:24.434959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:38:24.434959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:38:24.434959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:38:24.434959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:38:24.434959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 18:38:24.434959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:38:24.434959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 27 18:38:24.434959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi Jun 27 18:38:24.434959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:38:24.434959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi Jun 27 18:38:24.434959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:38:24.434959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:38:24.434959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:38:24.434959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:38:24.434959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:38:24.434959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 27 18:38:24.434959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: ERROR nova.api.openstack.wsgi Jun 27 18:38:24.434959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-968033c7-eef6-4b00-8c05-0c20d6554a4e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:38:24.436175 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-968033c7-eef6-4b00-8c05-0c20d6554a4e admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011659 Jun 27 18:38:24.436175 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Jun 27 18:38:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 18:38:25.248325 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-44e2109a-49a0-41ec-a79c-1881ae4ab365 admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:38:25.249341 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-44e2109a-49a0-41ec-a79c-1881ae4ab365 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 27 18:38:25.249741 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Jun 27 18:38:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:38:25.440515 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-5af44e31-69ae-4425-b699-5b345e47cc5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:38:25.547492 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-5af44e31-69ae-4425-b699-5b345e47cc5b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.159011 Jun 27 18:38:25.548121 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Jun 27 18:38:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 18:38:26.368751 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-44e2109a-49a0-41ec-a79c-1881ae4ab365 admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:38:26.369753 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-44e2109a-49a0-41ec-a79c-1881ae4ab365 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jun 27 18:38:26.370143 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Jun 27 18:38:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:38:26.561332 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-829b3a9c-b01b-497f-a82e-19bc19799fcb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:38:26.633672 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-829b3a9c-b01b-497f-a82e-19bc19799fcb admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.124697 Jun 27 18:38:26.634207 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 29/56] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Jun 27 18:38:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 18:38:27.458197 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-44e2109a-49a0-41ec-a79c-1881ae4ab365 admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:38:27.459229 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-44e2109a-49a0-41ec-a79c-1881ae4ab365 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jun 27 18:38:27.459629 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Jun 27 18:38:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:38:27.649817 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-b1ca9c3e-225a-48f9-b02b-64fdae35d303 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:38:27.727174 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-b1ca9c3e-225a-48f9-b02b-64fdae35d303 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.129377 Jun 27 18:38:27.727641 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 30/58] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Jun 27 18:38:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 18:38:28.554305 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-44e2109a-49a0-41ec-a79c-1881ae4ab365 admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:38:28.555380 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-44e2109a-49a0-41ec-a79c-1881ae4ab365 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jun 27 18:38:28.555879 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 29/59] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Jun 27 18:38:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:38:28.752978 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-7249cddd-5c0c-4f35-b1e4-bab9939bd0d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:38:28.834039 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-7249cddd-5c0c-4f35-b1e4-bab9939bd0d9 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.133220 Jun 27 18:38:28.834612 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 31/60] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Jun 27 18:38:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 18:38:29.655619 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-44e2109a-49a0-41ec-a79c-1881ae4ab365 admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:38:29.657188 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-44e2109a-49a0-41ec-a79c-1881ae4ab365 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 27 18:38:29.657606 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 30/61] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Jun 27 18:38:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:38:29.851468 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-ff4bbb0a-2352-4ac2-838d-4d0eea64cd4b admin admin] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:38:29.871003 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-ff4bbb0a-2352-4ac2-838d-4d0eea64cd4b admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071712 Jun 27 18:38:29.871540 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1202 bytes} [Mon Jun 27 18:38:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:39:16.959236 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-44e2109a-49a0-41ec-a79c-1881ae4ab365 admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:39:16.960251 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-44e2109a-49a0-41ec-a79c-1881ae4ab365 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 27 18:39:16.960663 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 930 bytes} [Mon Jun 27 18:39:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:39:16.971654 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG dbcounter [-] [110198] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:39:17.023333 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-513a6732-8a8b-40eb-9b80-da52fd546fe7 admin admin] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:39:17.042797 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-513a6732-8a8b-40eb-9b80-da52fd546fe7 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076143 Jun 27 18:39:17.043347 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 33/64] 10.222.0.15 () {60 vars in 1291 bytes} [Mon Jun 27 18:39:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:39:17.066285 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-f340117b-de43-4d5c-a7fd-c09b2927e204 admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:39:17.071066 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG dbcounter [-] [110199] Writing DB stats nova_api:SELECT=14 {{(pid=110199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:39:17.075961 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-f340117b-de43-4d5c-a7fd-c09b2927e204 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013424 Jun 27 18:39:17.077171 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1282 bytes} [Mon Jun 27 18:39:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:39:17.088841 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-07c34d34-ba99-4479-879f-15b9cc386e0f admin admin] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:39:17.097582 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-07c34d34-ba99-4479-879f-15b9cc386e0f admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012387 Jun 27 18:39:17.098098 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 34/66] 10.222.0.15 () {60 vars in 1285 bytes} [Mon Jun 27 18:39:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:39:17.109498 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-6528b206-52bc-403b-8205-912261a5910e admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:39:17.117966 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-6528b206-52bc-403b-8205-912261a5910e admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012115 Jun 27 18:39:17.118515 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 33/67] 10.222.0.15 () {60 vars in 1285 bytes} [Mon Jun 27 18:39:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:39:17.129827 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-2796ff0e-79dc-4cfc-93f4-f73ae5803a54 admin admin] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:39:17.137288 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-2796ff0e-79dc-4cfc-93f4-f73ae5803a54 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010996 Jun 27 18:39:17.137803 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 35/68] 10.222.0.15 () {60 vars in 1282 bytes} [Mon Jun 27 18:39:17 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:43:06.416729 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-6528b206-52bc-403b-8205-912261a5910e admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:43:06.417741 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-6528b206-52bc-403b-8205-912261a5910e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002034 Jun 27 18:43:06.418139 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Jun 27 18:43:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:43:06.560487 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG dbcounter [-] [110198] Writing DB stats nova_api:SELECT=6 {{(pid=110198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:43:06.674217 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-ac05f9fc-bff7-41f4-aa74-04f265c3ac72 admin admin] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:43:06.675452 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 18:43:06.675452 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: warnings.warn(msg) Jun 27 18:43:06.676653 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG oslo_concurrency.lockutils [None req-ac05f9fc-bff7-41f4-aa74-04f265c3ac72 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:43:06.677094 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG oslo_concurrency.lockutils [None req-ac05f9fc-bff7-41f4-aa74-04f265c3ac72 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:43:06.677878 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG oslo_concurrency.lockutils [None req-ac05f9fc-bff7-41f4-aa74-04f265c3ac72 admin admin] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:43:06.678307 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG oslo_concurrency.lockutils [None req-ac05f9fc-bff7-41f4-aa74-04f265c3ac72 admin admin] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:43:06.712813 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-ac05f9fc-bff7-41f4-aa74-04f265c3ac72 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.153747 Jun 27 18:43:06.713390 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 36/70] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Jun 27 18:43:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 18:43:07.540786 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-6528b206-52bc-403b-8205-912261a5910e admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:43:07.542089 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-6528b206-52bc-403b-8205-912261a5910e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001725 Jun 27 18:43:07.542511 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 35/71] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Jun 27 18:43:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:43:07.735718 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-dbc493b0-1b82-4c26-96e4-047f22af73a7 admin admin] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:43:07.736899 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 18:43:07.736899 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: warnings.warn(msg) Jun 27 18:43:07.738091 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG oslo_concurrency.lockutils [None req-dbc493b0-1b82-4c26-96e4-047f22af73a7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:43:07.738560 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG oslo_concurrency.lockutils [None req-dbc493b0-1b82-4c26-96e4-047f22af73a7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:43:07.739352 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG oslo_concurrency.lockutils [None req-dbc493b0-1b82-4c26-96e4-047f22af73a7 admin admin] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:43:07.739780 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG oslo_concurrency.lockutils [None req-dbc493b0-1b82-4c26-96e4-047f22af73a7 admin admin] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:43:07.758959 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-dbc493b0-1b82-4c26-96e4-047f22af73a7 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075063 Jun 27 18:43:07.759461 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 37/72] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Jun 27 18:43:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 18:43:18.993545 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-6528b206-52bc-403b-8205-912261a5910e admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:43:18.994603 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-6528b206-52bc-403b-8205-912261a5910e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Jun 27 18:43:18.994993 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Jun 27 18:43:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:43:19.138371 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG dbcounter [-] [110198] Writing DB stats nova_cell0:SELECT=4 {{(pid=110198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:43:19.139115 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG dbcounter [-] [110198] Writing DB stats nova_cell1:SELECT=4 {{(pid=110198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:43:19.139730 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG dbcounter [-] [110198] Writing DB stats nova_api:SELECT=8 {{(pid=110198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:43:19.188076 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-57e8f9e7-8044-47d5-9d44-ecfbbc55d9fd admin admin] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:43:19.189232 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 18:43:19.189232 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: warnings.warn(msg) Jun 27 18:43:19.190438 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG oslo_concurrency.lockutils [None req-57e8f9e7-8044-47d5-9d44-ecfbbc55d9fd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:43:19.195669 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG oslo_concurrency.lockutils [None req-57e8f9e7-8044-47d5-9d44-ecfbbc55d9fd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:43:19.195669 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG oslo_concurrency.lockutils [None req-57e8f9e7-8044-47d5-9d44-ecfbbc55d9fd admin admin] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:43:19.195669 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG oslo_concurrency.lockutils [None req-57e8f9e7-8044-47d5-9d44-ecfbbc55d9fd admin admin] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:43:19.219200 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-57e8f9e7-8044-47d5-9d44-ecfbbc55d9fd admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085933 Jun 27 18:43:19.219770 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 38/74] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Jun 27 18:43:19 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:43:20.044599 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: DEBUG nova.api.openstack.wsgi [None req-6528b206-52bc-403b-8205-912261a5910e admin admin] Calling method '>' {{(pid=110199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:43:20.045604 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: INFO nova.api.openstack.requestlog [None req-6528b206-52bc-403b-8205-912261a5910e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 27 18:43:20.046001 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: [pid: 110199|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Jun 27 18:43:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:43:20.236637 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG nova.api.openstack.wsgi [None req-8bcfe291-9a19-48dd-bf0d-814aced10f45 admin admin] Calling method '>' {{(pid=110198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:43:20.237876 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 18:43:20.237876 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: warnings.warn(msg) Jun 27 18:43:20.239309 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG oslo_concurrency.lockutils [None req-8bcfe291-9a19-48dd-bf0d-814aced10f45 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:43:20.239813 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG oslo_concurrency.lockutils [None req-8bcfe291-9a19-48dd-bf0d-814aced10f45 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:43:20.240643 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG oslo_concurrency.lockutils [None req-8bcfe291-9a19-48dd-bf0d-814aced10f45 admin admin] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:43:20.241075 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: DEBUG oslo_concurrency.lockutils [None req-8bcfe291-9a19-48dd-bf0d-814aced10f45 admin admin] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:43:20.263588 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: INFO nova.api.openstack.requestlog [None req-8bcfe291-9a19-48dd-bf0d-814aced10f45 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079220 Jun 27 18:43:20.264072 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: [pid: 110198|app: 0|req: 39/76] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Jun 27 18:43:20 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:44:15.142125 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: Mon Jun 27 18:44:15 2022 - graceful shutdown triggered... Jun 27 18:44:15.142682 dv-cinder-844601-6-iscsi devstack@n-api.service[110198]: Gracefully killing worker 1 (pid: 110198)... Jun 27 18:44:15.143976 dv-cinder-844601-6-iscsi devstack@n-api.service[110199]: Gracefully killing worker 2 (pid: 110199)... Jun 27 18:44:15.144222 dv-cinder-844601-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 27 18:44:16.145070 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: worker 1 buried after 1 seconds Jun 27 18:44:16.145632 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: worker 2 buried after 1 seconds Jun 27 18:44:16.145632 dv-cinder-844601-6-iscsi devstack@n-api.service[110197]: goodbye to uWSGI. Jun 27 18:44:16.146621 dv-cinder-844601-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 27 18:44:16.147236 dv-cinder-844601-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 27 18:44:16.149988 dv-cinder-844601-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 27 18:44:16.159964 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 27 18:44:16.161850 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 27 18:44:16 2022] *** Jun 27 18:44:16.161850 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 27 18:44:16.161850 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 27 18:44:16.161850 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: nodename: dv-cinder-844601-6-iscsi Jun 27 18:44:16.161850 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: machine: x86_64 Jun 27 18:44:16.161850 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: clock source: unix Jun 27 18:44:16.161850 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: pcre jit disabled Jun 27 18:44:16.161850 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: detected number of CPU cores: 4 Jun 27 18:44:16.161850 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: current working directory: / Jun 27 18:44:16.161850 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: detected binary path: /usr/bin/uwsgi-core Jun 27 18:44:16.161850 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: your processes number limit is 47680 Jun 27 18:44:16.162583 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: your memory page size is 4096 bytes Jun 27 18:44:16.162583 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: detected max file descriptor number: 2048 Jun 27 18:44:16.162583 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: lock engine: pthread robust mutexes Jun 27 18:44:16.162583 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: thunder lock: enabled Jun 27 18:44:16.162583 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 27 18:44:16.162583 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 27 18:44:16.208198 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: Python main interpreter initialized at 0x55c5000cc9c0 Jun 27 18:44:16.208198 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: python threads support enabled Jun 27 18:44:16.208198 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: your server socket listen backlog is limited to 100 connections Jun 27 18:44:16.208198 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: your mercy for graceful operations on workers is 90 seconds Jun 27 18:44:16.208606 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: mapped 403077 bytes (393 KB) for 2 cores Jun 27 18:44:16.208606 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: *** Operational MODE: preforking *** Jun 27 18:44:16.208889 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: *** uWSGI is running in multiple interpreter mode *** Jun 27 18:44:16.208889 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: spawned uWSGI master process (pid: 124705) Jun 27 18:44:16.209087 dv-cinder-844601-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 27 18:44:16.210235 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: spawned uWSGI worker 1 (pid: 124716, cores: 1) Jun 27 18:44:16.210235 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: spawned uWSGI worker 2 (pid: 124717, cores: 1) Jun 27 18:44:16.210235 dv-cinder-844601-6-iscsi devstack@n-api.service[124705]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 27 18:44:16.886554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 18:44:16.889104 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 18:44:18.107654 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 18:44:18.107654 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: from cryptography.utils import int_from_bytes Jun 27 18:44:18.108292 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 18:44:18.108292 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: from cryptography.utils import int_from_bytes Jun 27 18:44:18.108423 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 18:44:18.108423 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: from cryptography.utils import int_from_bytes Jun 27 18:44:18.108809 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 18:44:18.108809 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: from cryptography.utils import int_from_bytes Jun 27 18:44:20.536552 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 18:44:20.537112 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 18:44:20.537342 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 18:44:20.537619 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 18:44:20.537877 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 18:44:20.538266 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.538619 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.538940 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.539260 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.539588 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.539900 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.540225 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.540548 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.540875 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.541139 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.541453 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.541779 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844601-6-iscsi {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.542101 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.542428 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.542811 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.543140 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.543445 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.543771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.544080 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.544584 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.545950 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.545950 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.545950 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.545950 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.546257 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.546582 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.546892 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.547204 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.547531 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.547853 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.548239 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844601-6-iscsi {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.548565 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.548867 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.549186 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.549611 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.549925 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.550220 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.550564 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.550881 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.551200 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.551514 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.551824 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.552103 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 18:44:20.552551 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.552636 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 18:44:20.552715 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.552715 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.552993 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 18:44:20.553190 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.553276 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 18:44:20.553356 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.553557 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 18:44:20.553663 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.553907 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.554017 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.554212 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.554309 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.554536 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.554620 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.554805 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.554910 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.555096 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.555259 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.555418 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.555592 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.555750 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.555902 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.556054 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.556205 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.556358 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.556515 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.556657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.556811 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.557027 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.557195 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.557366 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.557523 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844601-6-iscsi {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.557692 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.557850 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.557998 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.558146 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.558297 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.559072 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.559245 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.559395 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.559545 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.559694 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.559836 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.559986 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.560169 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.560334 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.560497 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.560497 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.560822 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.560980 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.561738 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.561898 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.562049 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.562202 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.562355 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.562543 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.562715 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.563095 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.563252 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.563424 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.563567 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.563718 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.563876 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.564026 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.565107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.565303 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.565473 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.565625 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.565799 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.565944 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.566094 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844601-6-iscsi {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.566236 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.566451 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.566634 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.566786 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.566939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.567263 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.567421 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.567421 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.567709 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.567853 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.568014 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.568156 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.568297 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.569310 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.569475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.569667 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.569831 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.569993 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.570146 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.570298 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.570485 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.570682 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.570830 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.570996 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.571140 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.571317 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.571560 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.571732 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.571883 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.572025 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.572176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.572326 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.572468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.572617 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.572770 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.572928 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.573084 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.573226 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.573375 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.573524 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.573672 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.573814 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.574791 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.574965 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.575080 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.575171 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.575273 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.575368 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.575469 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.575565 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.575663 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.575764 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.575858 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.575954 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.576041 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.576140 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.576240 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.576334 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.576420 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.576511 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.576604 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.576696 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.576794 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.576887 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.576972 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.577062 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.577154 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.577247 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.577346 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.577441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.577536 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.577622 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.577701 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.577793 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.577888 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.577974 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.578058 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.578153 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.578248 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.578347 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.578468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.578556 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.578641 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.578734 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.578828 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.578923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.579017 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.579113 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.579207 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.579299 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.579393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.579490 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.579587 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.579672 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.579757 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.579840 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.579932 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.580018 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.580018 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.580186 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.580277 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.580369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.580369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.580610 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.580702 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.580788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.580788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.580949 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.581043 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.581129 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.581366 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.581565 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.581724 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.581874 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.582036 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.582180 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.582369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.582712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.582867 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.583052 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.583209 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.583307 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.583459 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.583556 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.583686 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.583814 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.583906 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.583990 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.584232 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.584323 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.584557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.584659 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.584868 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.584982 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.585180 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.585309 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.585492 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.585679 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.585829 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.585989 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.586151 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.586296 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.586441 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.586591 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.586690 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.586783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.587015 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.587117 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.587338 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.587432 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.587650 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.587755 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.587960 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.588054 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.588270 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.588364 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.588578 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.588684 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.588885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.589071 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.589227 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.589386 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.589572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.589815 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.589911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.590166 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.590267 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.590508 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.590624 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.590824 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.590919 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.591151 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.591244 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.591463 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.591564 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.591773 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.591864 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.592096 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.592204 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.592425 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.592588 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.592731 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.592870 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.593015 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.593110 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.593308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.593416 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.593616 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.593707 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.593921 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.594014 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.594225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.594331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.594563 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.594666 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.594875 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.594969 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.595183 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.595321 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.595494 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.595782 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.595877 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.595979 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.596108 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.596278 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.596422 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.596513 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.596715 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.596815 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.597024 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.597130 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.597328 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.597419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.597632 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.597776 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:44:20.597946 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.598113 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.598244 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.598345 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.598587 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.598683 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.598915 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.599023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.599221 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.599323 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.599554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.599649 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.599859 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.599954 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.600168 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.600268 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.600478 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.600581 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.600786 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.600881 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.601089 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.601189 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.601398 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.601499 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.601709 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.601811 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.602011 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.602112 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.602333 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.602567 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.602668 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.602760 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.602959 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.603053 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.603278 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.603385 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.603584 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.603685 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.603890 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.603991 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.604204 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.604311 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.604517 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.604612 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.604826 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.604920 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.605135 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.605261 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.605490 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.605867 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.606084 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.606177 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.606315 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.607236 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.607404 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.607558 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.607712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.607863 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.608029 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.608188 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.608340 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.608515 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.608675 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.608828 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.609244 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.609404 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.609567 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.609736 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.609897 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.610048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.610215 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.610367 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.610544 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.610544 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.610864 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.611024 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.611185 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.611343 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.611501 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.611501 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.611796 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.611958 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.612055 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.612149 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.612243 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.612337 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.612422 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.612517 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.612602 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.612745 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.612835 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.612929 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.613014 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.613108 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.613201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.613297 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.613390 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.613475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.613559 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.613681 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.613776 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.613990 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.614091 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.614300 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.614447 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.615421 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.615570 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.615688 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.615795 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.615877 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.615967 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.616062 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.616148 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.616240 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.616334 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.616420 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.616518 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.616595 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.616666 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.616970 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.617068 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.617141 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.617229 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.617433 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.617543 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.617685 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.617824 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.618000 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.618143 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.618312 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.618488 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.618648 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.618814 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.618974 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.619125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.619289 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.619445 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.619597 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.619749 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.619922 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.620063 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.620233 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.620402 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.620542 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.620733 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.621553 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.621729 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.621827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.621914 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.622000 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.622233 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.622345 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.622573 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.622681 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.622884 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.622986 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.623195 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.623297 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.623504 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.623598 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.623814 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.623908 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.624135 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.624237 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.624445 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.624546 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.624762 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.624856 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.625071 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.625171 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.625392 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.625486 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.625699 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.625793 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.626016 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.626114 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.626321 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.626434 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.626660 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.626771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.626969 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.627121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.627281 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.627389 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.627588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.627701 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.627896 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.627990 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.628203 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.628297 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.628509 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.628617 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.628816 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.628917 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.629126 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.629262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.629432 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.629536 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.629737 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.629830 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.630044 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.630145 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.630351 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.630477 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.630685 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.630786 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.630998 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.631102 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.631302 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.631397 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.631615 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.631709 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.631923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.632025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.632228 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.632323 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.632532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.632635 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.632845 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.632946 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.633168 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.633271 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.633478 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.633572 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.633799 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.633901 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.634111 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.634215 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.634441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.634573 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.634751 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.634870 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.635076 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.635385 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.635609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.635711 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.635935 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.636127 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.636266 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.636361 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.636700 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.636852 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.637472 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.637599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.637684 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.637819 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.637920 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.638014 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.638109 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.638205 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.638290 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.638414 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.638555 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.638665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.638866 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.638961 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.639176 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.639270 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.639499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.639593 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.639813 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.639914 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.640121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.640216 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.640433 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.640526 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.640742 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.640836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.641052 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.641154 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.641359 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.641460 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.641680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.641774 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.641987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.642088 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.642297 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.642436 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.642629 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.642735 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.642932 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.643026 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.643240 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.643344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.643555 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.643648 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.643885 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.644127 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.644227 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.644460 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.644555 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.644775 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.644875 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.645093 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.645194 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.645409 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.645504 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.645726 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.645821 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.646040 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.646144 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.646352 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.646533 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.646678 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.646775 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.646988 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.647097 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.647308 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.647402 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.647611 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.647712 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.647916 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.648017 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.648223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.648326 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.648525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.648627 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.648829 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.648930 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.649131 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.649238 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.649434 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.649526 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.649733 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.649828 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.650038 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.650147 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.650341 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.650477 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.650668 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.650769 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.650984 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.651124 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.651286 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.651398 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.651594 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.651688 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.651896 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.651999 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.652734 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.652956 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.653060 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.653339 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.653485 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.653654 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.653750 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.653991 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.654085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.654302 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.654416 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.654639 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.654742 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.654960 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.655054 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.655285 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.655394 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.655599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.655701 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.655921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.656016 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.656236 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.656380 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.656549 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.656651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.656872 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.656965 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.657178 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.657295 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.657484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.657594 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.657794 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.657895 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.658102 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.658217 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.658474 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.658601 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.658734 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.658836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.659043 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.659147 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.659351 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.659447 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.659663 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.659755 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.659971 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.660073 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.660274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.660369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.660583 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.660685 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.660885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.660980 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.661202 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.661457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.661559 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.661798 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.661901 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.662100 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.662192 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.662436 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.662546 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.662748 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.662898 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.663050 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.663145 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.663363 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.663486 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.663659 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.663769 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.663973 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.664116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.664277 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.664428 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.664579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.664745 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.664881 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.665055 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.665192 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.665365 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.665499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.665682 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.665800 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.665993 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.666122 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.666302 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.666454 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.666638 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.666762 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.666953 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.667049 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.667262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.667387 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.667575 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.667700 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.668481 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.668712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.668877 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.669031 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.669204 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.669359 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.669517 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.669679 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.669836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.669988 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.670146 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.670301 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.670501 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.670631 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.670819 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.670940 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.671127 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.671248 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.671439 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.671550 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.671745 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.671840 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.672092 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.672198 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.672403 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.672503 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.672715 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.672813 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.673021 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.673178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.673344 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.673487 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.673656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.673765 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.673961 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.674056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.674267 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.674360 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.674598 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.674699 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.674929 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.675036 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.675236 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.675336 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.675549 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.675649 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.675862 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.675955 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.676167 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.676267 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.676482 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.676608 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.676791 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.676892 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.677099 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.677208 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.677414 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.677530 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.677718 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.677818 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.678026 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.678125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.678333 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.678461 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.678672 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.678779 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.678978 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.679079 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.679283 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.679393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.679589 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.679708 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.679916 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.680009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.680212 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.680320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.680516 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.680607 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.680830 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.680928 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.681138 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.681237 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.681461 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.681558 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.681754 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.681853 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.682061 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.682162 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.682366 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.682485 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.682694 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.682795 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.683001 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.683106 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.683308 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.683413 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.683709 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.683860 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.684027 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.684189 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.684283 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.684505 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.684599 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.684819 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.684919 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.685141 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.685394 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.685495 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.685713 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.685815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.686027 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.686127 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.686345 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.686460 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.686671 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.686774 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.686981 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.687080 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.687286 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.687378 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.687597 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.687704 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.687906 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.688008 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.688225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.688323 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.688536 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.688637 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.688850 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.688952 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.689159 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.689253 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.689471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.689573 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.689779 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.689871 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.690086 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.690185 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.690437 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.690547 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.690731 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.690830 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.691044 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.691135 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.691352 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.691453 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.691662 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.691762 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.691969 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.692071 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.692318 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.692418 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.692619 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.692710 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.692929 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.693032 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.693250 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.693364 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.693556 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.693682 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.693860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.693982 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.694164 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.694276 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.694538 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.694642 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.694855 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.694969 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.695163 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.695257 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.695482 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.695620 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.695796 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.695916 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.696112 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.696216 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.696420 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.696625 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.696791 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.696931 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.697075 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.697229 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.697367 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.697544 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.697692 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.697874 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.697973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.698198 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.698293 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.698535 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.698649 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.698854 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.698959 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.699280 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.699380 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.699599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.699692 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.699915 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.700010 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.700230 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.700322 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.700545 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.700645 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.700860 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.700954 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.701176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.701270 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.701493 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.701592 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.701808 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.701909 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.702123 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.702217 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.702456 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.702554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.702771 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.702872 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.703083 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.703257 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.703392 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.703485 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.703727 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.703840 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.704039 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.704148 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.704347 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.704446 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.704661 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.704763 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.704968 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.705069 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.705275 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.705367 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.705582 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.705672 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.705888 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.706014 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.706200 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.706331 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.706534 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.706689 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.706828 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.706998 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.707133 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.707315 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.707422 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.707629 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.707779 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.707949 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.708043 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.708268 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.708370 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.708576 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.708668 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.708964 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.709062 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.709287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.709390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.709594 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.709686 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.709906 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.710007 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.710213 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.710318 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.710541 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.710673 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.710847 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.710978 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.711152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.711261 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.711465 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.711557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.711773 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.711910 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.712081 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.712175 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.712409 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.712509 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.712716 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.712809 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.713033 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.713132 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.713367 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.713468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.713695 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.713842 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.714013 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.714107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.714331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.714497 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.715224 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.715387 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.715563 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.715715 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.715914 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.716011 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.716226 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.716330 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.716533 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.716626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.716842 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.716935 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.717148 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.717257 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.717459 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.717553 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.717764 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.717867 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.718069 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.718175 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.718401 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.718497 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.718722 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.718816 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.719029 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.719184 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.719353 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.719452 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.719662 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.719753 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.719968 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.720075 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.720274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.720367 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.720577 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.720698 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.720920 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.721024 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.721227 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.721321 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.721567 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.721668 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.721877 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.722015 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.722200 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.722294 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.722551 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.722658 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.722862 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.722963 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.723184 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.723277 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.723492 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.723658 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.723806 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.723898 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.724117 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.724217 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.724430 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.724534 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.724743 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.724841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.725055 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.725154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.725362 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.725525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.725667 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.725766 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.725981 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.726079 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.726288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.726413 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.726626 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.726730 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.726948 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.727145 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.727273 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.727472 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.727600 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.727787 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.727908 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.728100 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.728243 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.728419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.728534 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.728733 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.728825 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.729044 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.729146 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.729355 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.729451 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.729665 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.729772 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.730103 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.730255 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.731011 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.731163 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.731355 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.731458 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.731691 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.731785 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.732007 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.732146 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.732345 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.732439 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.732676 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.732776 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.732998 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.733105 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.733321 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.733414 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.733636 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.733749 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.734253 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.734469 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.734608 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.734738 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.734857 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.734968 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.735150 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.735278 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.735463 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.735595 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.735775 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.735895 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.736091 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.736216 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.736399 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.736532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.736708 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.736835 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.737016 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.737142 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.737325 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.737443 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.737636 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.737769 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.737949 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.738068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.738290 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.738452 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.738642 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.738769 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.738961 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.739077 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.739270 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.739396 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.739597 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.739713 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.739913 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.740043 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.740230 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.740354 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.740562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.740760 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.740879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.741077 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.741207 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.741411 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.741511 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.741736 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.741837 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.742059 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.742162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.742403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.742541 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.742739 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.742846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.743070 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.743172 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.743377 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.743477 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.743685 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.743794 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.743997 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.744104 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.744318 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.744425 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.744614 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.744725 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.744932 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.745024 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.745242 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.745341 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.745550 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.745779 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.745964 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.746172 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.746471 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.746629 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.746967 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.747076 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.747289 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.747388 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.747610 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.747709 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.747935 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.748060 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.748249 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.748347 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.748564 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.748674 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.748878 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.748980 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.749196 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.749291 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.749518 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.749620 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.749826 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.749926 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.750143 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.750275 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.750488 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.750626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.750796 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.750923 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.751100 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.751197 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.751411 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.751513 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.751718 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.751811 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.752022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.752115 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.752333 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.752429 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.752638 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.752738 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.752962 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.753064 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.753267 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.753361 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.753571 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.753666 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.753875 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.753982 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.754188 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.754292 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.754515 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.754611 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.754820 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.754925 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.755125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.755225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.755429 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.755523 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.755745 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.755921 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.756050 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.756142 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.756360 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.756454 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.756666 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.756759 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.756976 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.757077 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.757280 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.757380 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.757590 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.757691 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.757926 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.758029 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.758269 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.758471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.758629 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.758791 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.758886 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.759129 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.759224 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.759458 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.759559 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.759784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.759879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.760107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.760206 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.760417 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.760510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.760747 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.760875 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.761056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.761151 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.761364 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.761645 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.761898 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.761992 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.762288 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.762404 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.762647 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.762749 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.762976 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.763069 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.763282 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.763428 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.763589 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.763683 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.763892 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.763986 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.764210 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.764311 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.764522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.764756 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.764901 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.765116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.765210 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.765431 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.765524 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.765742 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.765842 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.766052 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.766146 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.766361 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.766512 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.766693 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.766785 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.767004 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.767111 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.767330 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.767443 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.767624 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.767722 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.767931 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.768087 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.768239 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.768333 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.768545 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.768672 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.768854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.768965 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.769169 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.769263 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.769481 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.769575 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.769788 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.769894 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.770100 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.770200 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.770438 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.770535 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.770758 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.770896 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.771055 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.771158 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.771363 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.771456 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.771670 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.771772 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.771986 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.772080 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.772295 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.772389 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.772598 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.772698 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.772905 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.773109 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.773204 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.773424 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.773518 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.773742 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.773836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.774064 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.774158 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.774376 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.774496 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.774716 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.774816 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.775037 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.775147 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.775347 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.775440 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.775665 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.775758 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.775978 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.776085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.776307 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.776401 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.776613 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.776704 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.776934 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.777040 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.777770 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.777871 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.778100 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.778238 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.778427 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.778539 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.778737 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.778839 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.779054 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.779176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.779372 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.779499 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.779682 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.779985 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.780083 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.780290 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.780392 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.780602 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.780704 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.780909 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.781039 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.781214 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.781323 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.781518 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.781614 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.781822 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.781924 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.782130 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.782237 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.782457 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.782564 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.782765 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.782869 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.783069 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.783171 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.783372 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.783465 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.783675 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.783775 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.783978 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.784071 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.784287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.784381 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.784590 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.784684 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.784896 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.784997 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.785200 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.785295 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.785503 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.785603 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.785805 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.785899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.786136 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.786487 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.786629 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.786806 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.786907 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.787127 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.787222 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.787435 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.787526 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.787759 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.787853 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.788070 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.788163 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.788393 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.788493 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.788712 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.788810 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.789028 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.789131 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.789338 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.789430 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.789649 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.789748 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.789963 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.790063 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.790272 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.790372 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.790605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.790709 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.790915 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.791044 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.791225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.791371 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.791536 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.791737 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.791863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.792055 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.792191 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.792378 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.792496 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.792723 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.792912 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.793233 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.793334 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.793557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.793659 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.793873 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.793967 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.794185 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.794287 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.794533 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.794640 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.794844 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.794952 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.795154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.795261 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.795468 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.795562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.795779 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.795879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.796089 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.796183 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.796405 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.796505 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.796718 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.796869 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.797033 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.797127 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.797347 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.797448 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.797655 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.797753 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.797969 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.798061 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.798278 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.798630 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.798770 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.798882 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.799011 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.799114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.799200 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.799291 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.799500 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.799615 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.799808 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.799903 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.800116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.800223 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.800433 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.800565 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.800722 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 18:44:20.800828 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.801033 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.801342 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.801650 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.801955 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.802261 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.802605 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.802913 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.803222 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.803530 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.803838 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.804143 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.804480 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.804817 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.805141 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.805466 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.805780 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.806105 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.806438 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.806766 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.807095 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.807417 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.807730 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.809641 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.809976 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.810302 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.810652 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.810974 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.811466 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.811789 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.812128 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.812464 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.812781 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.813114 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.813439 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.813768 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.814090 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.814750 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.815108 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.815429 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.815747 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.816068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.816382 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.816697 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.817018 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.817337 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.817668 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.817997 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.818312 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.818670 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.819003 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.819355 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.819675 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.820023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.820353 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.820673 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.820989 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.821304 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:44:20.821554 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 18:44:20.866348 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO dbcounter [None req-2f82729b-07af-4ae2-8851-650d42ce0a40 None None] Registered counter for database nova_api Jun 27 18:44:20.887544 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_db.sqlalchemy.engines [None req-2f82729b-07af-4ae2-8851-650d42ce0a40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 18:44:20.888128 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO dbcounter [None req-152cad70-2e34-4834-bac7-a18b3d3b8a31 None None] Registered counter for database nova_api Jun 27 18:44:20.894313 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writer thread running {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 18:44:20.908136 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_db.sqlalchemy.engines [None req-152cad70-2e34-4834-bac7-a18b3d3b8a31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 18:44:20.914681 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writer thread running {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 18:44:20.951147 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.context [None req-2f82729b-07af-4ae2-8851-650d42ce0a40 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),22329c9e-12ee-4fdf-a1a3-6d021f43d687(cell1) {{(pid=124716) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 18:44:20.955314 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2f82729b-07af-4ae2-8851-650d42ce0a40 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:44:20.956917 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2f82729b-07af-4ae2-8851-650d42ce0a40 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:44:20.957725 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2f82729b-07af-4ae2-8851-650d42ce0a40 None None] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:44:20.959699 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2f82729b-07af-4ae2-8851-650d42ce0a40 None None] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:44:20.961684 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO dbcounter [None req-2f82729b-07af-4ae2-8851-650d42ce0a40 None None] Registered counter for database nova_cell0 Jun 27 18:44:20.966130 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO dbcounter [None req-2f82729b-07af-4ae2-8851-650d42ce0a40 None None] Registered counter for database nova_cell1 Jun 27 18:44:20.971719 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.context [None req-152cad70-2e34-4834-bac7-a18b3d3b8a31 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),22329c9e-12ee-4fdf-a1a3-6d021f43d687(cell1) {{(pid=124717) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 18:44:20.973292 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_db.sqlalchemy.engines [None req-2f82729b-07af-4ae2-8851-650d42ce0a40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 18:44:20.975510 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_db.sqlalchemy.engines [None req-2f82729b-07af-4ae2-8851-650d42ce0a40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 18:44:20.975943 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-152cad70-2e34-4834-bac7-a18b3d3b8a31 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:44:20.977567 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-152cad70-2e34-4834-bac7-a18b3d3b8a31 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:44:20.978451 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-152cad70-2e34-4834-bac7-a18b3d3b8a31 None None] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:44:20.981102 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-152cad70-2e34-4834-bac7-a18b3d3b8a31 None None] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:44:20.981636 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writer thread running {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 18:44:20.983271 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writer thread running {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 18:44:20.983417 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO dbcounter [None req-152cad70-2e34-4834-bac7-a18b3d3b8a31 None None] Registered counter for database nova_cell0 Jun 27 18:44:20.987716 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO dbcounter [None req-152cad70-2e34-4834-bac7-a18b3d3b8a31 None None] Registered counter for database nova_cell1 Jun 27 18:44:20.995229 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_db.sqlalchemy.engines [None req-152cad70-2e34-4834-bac7-a18b3d3b8a31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 18:44:20.996787 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_db.sqlalchemy.engines [None req-152cad70-2e34-4834-bac7-a18b3d3b8a31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 18:44:21.004389 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writer thread running {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 18:44:21.004789 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writer thread running {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 18:44:21.134836 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO dbcounter [None req-2f82729b-07af-4ae2-8851-650d42ce0a40 None None] Registered counter for database nova_cell0 Jun 27 18:44:21.142877 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_db.sqlalchemy.engines [None req-2f82729b-07af-4ae2-8851-650d42ce0a40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 18:44:21.148698 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writer thread running {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 18:44:21.158325 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO dbcounter [None req-152cad70-2e34-4834-bac7-a18b3d3b8a31 None None] Registered counter for database nova_cell0 Jun 27 18:44:21.165177 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_db.sqlalchemy.engines [None req-152cad70-2e34-4834-bac7-a18b3d3b8a31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 18:44:21.169811 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writer thread running {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 18:44:21.472775 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: WARNING keystonemiddleware.auth_token [None req-2f82729b-07af-4ae2-8851-650d42ce0a40 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 18:44:21.480437 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: WARNING keystonemiddleware.auth_token [None req-2f82729b-07af-4ae2-8851-650d42ce0a40 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 18:44:21.506351 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: WARNING keystonemiddleware.auth_token [None req-152cad70-2e34-4834-bac7-a18b3d3b8a31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 18:44:21.514841 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: WARNING keystonemiddleware.auth_token [None req-152cad70-2e34-4834-bac7-a18b3d3b8a31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 18:44:21.827261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: WARNING keystonemiddleware.auth_token [None req-2f82729b-07af-4ae2-8851-650d42ce0a40 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 18:44:21.833220 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: WARNING keystonemiddleware.auth_token [None req-2f82729b-07af-4ae2-8851-650d42ce0a40 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 18:44:21.838581 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c5000cc9c0 pid: 124716 (default app) Jun 27 18:44:21.862239 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: WARNING keystonemiddleware.auth_token [None req-152cad70-2e34-4834-bac7-a18b3d3b8a31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 18:44:21.868216 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: WARNING keystonemiddleware.auth_token [None req-152cad70-2e34-4834-bac7-a18b3d3b8a31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 18:44:21.873588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c5000cc9c0 pid: 124717 (default app) Jun 27 18:45:02.065564 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_api:SELECT=3 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:45:02.066713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=3 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:45:02.067472 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=3 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:45:02.068566 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=3 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:45:03.274646 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_api:SELECT=3 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:45:03.276402 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell0:SELECT=3 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:45:03.277596 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=3 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:45:03.278533 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell0:SELECT=3 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:45:03.387391 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-4b150130-2c1e-43b9-ba2a-1d98c0da8371 tempest-VolumesGetTestJSON-135348371 tempest-VolumesGetTestJSON-135348371-project] Action: 'create', calling method: .version_select at 0x7f701df4f280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-550947911", "metadata": {"Type": "work"}}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:45:04.187046 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-7eae1edc-46c6-4708-9272-73eac4d948db tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] Action: 'create', calling method: .version_select at 0x7f701df50310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-306879516", "metadata": {"Type": "work"}}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:45:04.199711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-7eae1edc-46c6-4708-9272-73eac4d948db tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] Request method failure captured: Jun 27 18:45:04.199711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 27 18:45:04.199711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 18:45:04.199711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 18:45:04.199711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 18:45:04.199711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 121 Jun 27 18:45:04.199711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 18:45:04.199711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 18:45:04.199711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 18:45:04.199711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 18:45:04.199711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufqvmch_LxYfAdSih9h3BFi8AK8KbwdoiiHaJrUDuJjCr0PJxOOQZ5K0oUaaFK3saHhlvqpBlsKD9DO7nuqnWziS62salUwVsyKiLK-leNApaBKUfUX6l3XFGHUkFHWvWGnTd0wgDe_Harj3Lxm0WI-gDxI3uGLwBsMG8NEGgV9uwos Jun 27 18:45:04.199711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 18:45:04.199711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 18:45:04.199711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 18:45:04.199711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 18:45:04.199711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 18:45:04.199711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 18:45:04.199711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: bcb48117fbeb47c99a3628629a66d28c Jun 27 18:45:04.199711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-VolumesNegativeTest-2025962632 Jun 27 18:45:04.199711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 18:45:04.199711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 18:45:04.201223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bcb48117fbeb47c99a3628629a66d28c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bcb48117fbeb47c99a3628629a66d28c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bcb48117fbeb47c99a3628629a66d28c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bcb48117fbeb47c99a3628629a66d28c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:45:04.201223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-VolumesNegativeTest-2025962632 Jun 27 18:45:04.201223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: bcb48117fbeb47c99a3628629a66d28c Jun 27 18:45:04.201223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-VolumesNegativeTest-2025962632 Jun 27 18:45:04.201223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-VolumesNegativeTest-2025962632-project Jun 27 18:45:04.201223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 18:45:04.201223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 18:45:04.201223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: 3502855d5bf4416997f07bb0cb39710e Jun 27 18:45:04.201223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-VolumesNegativeTest-2025962632-project Jun 27 18:45:04.201223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Jun 27 18:45:04.201223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-306879516", "metadata": {"Type": "work"}}} Jun 27 18:45:04.201223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: Jun 27 18:45:04.201223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 27 18:45:04.202225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-306879516', 'metadata': {'Type': 'work'}}}} Jun 27 18:45:04.202225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:45:04.202225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:04.202225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 27 18:45:04.202225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 27 18:45:04.202225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 27 18:45:04.202225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise error Jun 27 18:45:04.202225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 27 18:45:04.202225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:45:04.202225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 27 18:45:04.202225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 27 18:45:04.202225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:45:04.202225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 27 18:45:04.202225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi '#$%' Jun 27 18:45:04.202225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:45:04.202225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:04.202225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:45:04.202225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:04.202225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:45:04.202225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:45:04.202225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:45:04.202225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:45:04.203840 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 18:45:04.203840 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 18:45:04.203840 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:45:04.203840 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:45:04.203840 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 27 18:45:04.203840 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 27 18:45:04.203840 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 27 18:45:04.203840 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 27 18:45:04.203840 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 27 18:45:04.203840 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 27 18:45:04.203840 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 27 18:45:04.203840 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:45:04.203840 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:04.203840 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:45:04.203840 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:04.203840 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:45:04.203840 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:45:04.203840 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 27 18:45:04.203840 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 27 18:45:04.205246 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 27 18:45:04.205246 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:45:04.206138 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-7eae1edc-46c6-4708-9272-73eac4d948db tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:45:04.207957 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-7eae1edc-46c6-4708-9272-73eac4d948db tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.944159 Jun 27 18:45:04.210750 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1155 bytes} [Mon Jun 27 18:45:03 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 948 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 27 18:45:04.422963 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-b067788f-0b9e-466c-9a71-6575760272ed tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Action: 'create', calling method: .version_select at 0x7f701de37670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-913641142"}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:45:05.524158 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-4b150130-2c1e-43b9-ba2a-1d98c0da8371 tempest-VolumesGetTestJSON-135348371 tempest-VolumesGetTestJSON-135348371-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.471211 Jun 27 18:45:05.524158 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 1/2] 10.222.0.15 () {60 vars in 1155 bytes} [Mon Jun 27 18:45:02 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3474 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 27 18:45:05.533532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-46bddea3-b1ef-466a-a19b-f41fed71805e tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] Action: 'create', calling method: .version_select at 0x7f701de230d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-883952500", "metadata": {"Type": "work"}}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:45:05.543124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-46bddea3-b1ef-466a-a19b-f41fed71805e tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] Request method failure captured: Jun 27 18:45:05.543124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 27 18:45:05.543124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:45:05.543124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:45:05.543124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:45:05.543124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 119 Jun 27 18:45:05.543124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:45:05.543124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:45:05.543124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:45:05.543124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:45:05.543124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufqvmch_LxYfAdSih9h3BFi8AK8KbwdoiiHaJrUDuJjCr0PJxOOQZ5K0oUaaFK3saHhlvqpBlsKD9DO7nuqnWziS62salUwVsyKiLK-leNApaBKUfUX6l3XFGHUkFHWvWGnTd0wgDe_Harj3Lxm0WI-gDxI3uGLwBsMG8NEGgV9uwos Jun 27 18:45:05.543124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:45:05.543124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:45:05.543124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:45:05.543124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:45:05.543124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:45:05.543124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:45:05.543124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: bcb48117fbeb47c99a3628629a66d28c Jun 27 18:45:05.543124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-VolumesNegativeTest-2025962632 Jun 27 18:45:05.543124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:45:05.543124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:45:05.544568 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bcb48117fbeb47c99a3628629a66d28c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bcb48117fbeb47c99a3628629a66d28c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bcb48117fbeb47c99a3628629a66d28c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bcb48117fbeb47c99a3628629a66d28c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:45:05.544568 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-VolumesNegativeTest-2025962632 Jun 27 18:45:05.544568 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: bcb48117fbeb47c99a3628629a66d28c Jun 27 18:45:05.544568 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-VolumesNegativeTest-2025962632 Jun 27 18:45:05.544568 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-VolumesNegativeTest-2025962632-project Jun 27 18:45:05.544568 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:45:05.544568 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:45:05.544568 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: 3502855d5bf4416997f07bb0cb39710e Jun 27 18:45:05.544568 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-VolumesNegativeTest-2025962632-project Jun 27 18:45:05.544568 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Jun 27 18:45:05.544568 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-883952500", "metadata": {"Type": "work"}}} Jun 27 18:45:05.544568 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: Jun 27 18:45:05.544568 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 27 18:45:05.545410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-883952500', 'metadata': {'Type': 'work'}}}} Jun 27 18:45:05.545410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:45:05.545410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:05.545410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 27 18:45:05.545410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 27 18:45:05.545410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 27 18:45:05.545410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise error Jun 27 18:45:05.545410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 27 18:45:05.545410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:05.545410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 27 18:45:05.545410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 27 18:45:05.545410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:05.545410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 27 18:45:05.545410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi '0' Jun 27 18:45:05.545410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:05.545410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:05.545410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:05.545410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:05.545410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:45:05.545410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:45:05.545410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:45:05.545410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:45:05.546911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 18:45:05.546911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 18:45:05.546911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:45:05.546911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:45:05.546911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 27 18:45:05.546911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 27 18:45:05.546911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 27 18:45:05.546911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 27 18:45:05.546911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 27 18:45:05.546911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 27 18:45:05.546911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 27 18:45:05.546911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:05.546911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:05.546911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:05.546911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:05.546911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:45:05.546911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:45:05.546911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 27 18:45:05.546911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 27 18:45:05.548097 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 27 18:45:05.548097 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:05.548097 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-46bddea3-b1ef-466a-a19b-f41fed71805e tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:45:05.548097 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-46bddea3-b1ef-466a-a19b-f41fed71805e tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020151 Jun 27 18:45:05.563126 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 2/3] 10.222.0.15 () {60 vars in 1155 bytes} [Mon Jun 27 18:45:05 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 27 18:45:05.568409 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-e13849a4-3c56-4fb6-b66e-179e4adb49dc tempest-VolumesGetTestJSON-135348371 tempest-VolumesGetTestJSON-135348371-project] Calling method '.version_select at 0x7f701de04ee0>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:05.821795 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-e13849a4-3c56-4fb6-b66e-179e4adb49dc tempest-VolumesGetTestJSON-135348371 tempest-VolumesGetTestJSON-135348371-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/6689bd92-0071-499a-a0b6-9925aa986483" status: 200 len: 352 microversion: 2.1 time: 0.257345 Jun 27 18:45:05.822541 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 3/4] 10.222.0.15 () {58 vars in 1244 bytes} [Mon Jun 27 18:45:05 2022] GET /compute/v2.1/os-volumes/6689bd92-0071-499a-a0b6-9925aa986483 => generated 352 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:45:05.827408 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-1d938946-15fb-48d0-bfff-aafa4041084b tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] Action: 'create', calling method: .version_select at 0x7f701de233a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1486194087", "metadata": {"Type": "work"}}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:45:05.836419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-1d938946-15fb-48d0-bfff-aafa4041084b tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] Request method failure captured: Jun 27 18:45:05.836419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 27 18:45:05.836419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:45:05.836419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:45:05.836419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:45:05.836419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 119 Jun 27 18:45:05.836419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:45:05.836419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:45:05.836419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:45:05.836419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:45:05.836419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufqvmch_LxYfAdSih9h3BFi8AK8KbwdoiiHaJrUDuJjCr0PJxOOQZ5K0oUaaFK3saHhlvqpBlsKD9DO7nuqnWziS62salUwVsyKiLK-leNApaBKUfUX6l3XFGHUkFHWvWGnTd0wgDe_Harj3Lxm0WI-gDxI3uGLwBsMG8NEGgV9uwos Jun 27 18:45:05.836419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:45:05.836419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:45:05.836419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:45:05.836419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:45:05.836419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:45:05.836419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:45:05.836419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: bcb48117fbeb47c99a3628629a66d28c Jun 27 18:45:05.836419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-VolumesNegativeTest-2025962632 Jun 27 18:45:05.836419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:45:05.836419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:45:05.839381 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bcb48117fbeb47c99a3628629a66d28c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bcb48117fbeb47c99a3628629a66d28c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bcb48117fbeb47c99a3628629a66d28c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bcb48117fbeb47c99a3628629a66d28c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:45:05.839381 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-VolumesNegativeTest-2025962632 Jun 27 18:45:05.839381 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: bcb48117fbeb47c99a3628629a66d28c Jun 27 18:45:05.839381 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-VolumesNegativeTest-2025962632 Jun 27 18:45:05.839381 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-VolumesNegativeTest-2025962632-project Jun 27 18:45:05.839381 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:45:05.839381 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:45:05.839381 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: 3502855d5bf4416997f07bb0cb39710e Jun 27 18:45:05.839381 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-VolumesNegativeTest-2025962632-project Jun 27 18:45:05.839381 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Jun 27 18:45:05.839381 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1486194087", "metadata": {"Type": "work"}}} Jun 27 18:45:05.839381 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: Jun 27 18:45:05.839381 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 27 18:45:05.840353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1486194087', 'metadata': {'Type': 'work'}}}} Jun 27 18:45:05.840353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:45:05.840353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:05.840353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 27 18:45:05.840353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 27 18:45:05.840353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 27 18:45:05.840353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise error Jun 27 18:45:05.840353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 27 18:45:05.840353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:05.840353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 27 18:45:05.840353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 27 18:45:05.840353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:05.840353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 27 18:45:05.840353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi '' Jun 27 18:45:05.840353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:05.840353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:05.840353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:05.840353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:05.840353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:45:05.840353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:45:05.840353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:45:05.840353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:45:05.841924 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 18:45:05.841924 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 18:45:05.841924 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:45:05.841924 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:45:05.841924 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 27 18:45:05.841924 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 27 18:45:05.841924 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 27 18:45:05.841924 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 27 18:45:05.841924 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 27 18:45:05.841924 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 27 18:45:05.841924 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 27 18:45:05.841924 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:05.841924 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:05.841924 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:05.841924 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:05.841924 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:45:05.841924 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:45:05.841924 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 27 18:45:05.841924 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 27 18:45:05.846142 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 27 18:45:05.846142 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:05.846142 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-1d938946-15fb-48d0-bfff-aafa4041084b tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:45:05.846142 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-1d938946-15fb-48d0-bfff-aafa4041084b tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007618 Jun 27 18:45:05.846142 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 4/5] 10.222.0.15 () {60 vars in 1155 bytes} [Mon Jun 27 18:45:05 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 27 18:45:05.855150 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-33cb08fa-9b0b-43d9-b2ab-5f92d715db40 tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] Calling method '.version_select at 0x7f701dddbb80>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:06.153887 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-33cb08fa-9b0b-43d9-b2ab-5f92d715db40 tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] HTTP exception thrown: Volume tempest-invalid-1513343107 could not be found. Jun 27 18:45:06.159890 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-33cb08fa-9b0b-43d9-b2ab-5f92d715db40 tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] Request method failure captured: Jun 27 18:45:06.159890 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1513343107 HTTP/1.1 Jun 27 18:45:06.159890 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:45:06.159890 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:45:06.159890 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:45:06.159890 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:45:06.159890 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:45:06.159890 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:45:06.159890 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:45:06.159890 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:45:06.159890 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufqvmch_LxYfAdSih9h3BFi8AK8KbwdoiiHaJrUDuJjCr0PJxOOQZ5K0oUaaFK3saHhlvqpBlsKD9DO7nuqnWziS62salUwVsyKiLK-leNApaBKUfUX6l3XFGHUkFHWvWGnTd0wgDe_Harj3Lxm0WI-gDxI3uGLwBsMG8NEGgV9uwos Jun 27 18:45:06.159890 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:45:06.159890 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:45:06.159890 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:45:06.159890 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:45:06.159890 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:45:06.159890 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:45:06.159890 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: bcb48117fbeb47c99a3628629a66d28c Jun 27 18:45:06.159890 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-VolumesNegativeTest-2025962632 Jun 27 18:45:06.159890 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:45:06.159890 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:45:06.161417 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bcb48117fbeb47c99a3628629a66d28c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bcb48117fbeb47c99a3628629a66d28c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bcb48117fbeb47c99a3628629a66d28c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bcb48117fbeb47c99a3628629a66d28c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:45:06.161417 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-VolumesNegativeTest-2025962632 Jun 27 18:45:06.161417 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: bcb48117fbeb47c99a3628629a66d28c Jun 27 18:45:06.161417 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-VolumesNegativeTest-2025962632 Jun 27 18:45:06.161417 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-VolumesNegativeTest-2025962632-project Jun 27 18:45:06.161417 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:45:06.161417 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:45:06.161417 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: 3502855d5bf4416997f07bb0cb39710e Jun 27 18:45:06.161417 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-VolumesNegativeTest-2025962632-project Jun 27 18:45:06.161417 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: Jun 27 18:45:06.161417 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Volume tempest-invalid-1513343107 could not be found. Jun 27 18:45:06.161417 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': 'tempest-invalid-1513343107'} Jun 27 18:45:06.161417 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:45:06.162222 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:06.162222 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 18:45:06.162222 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 18:45:06.162222 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 18:45:06.162222 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 18:45:06.162222 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 18:45:06.162222 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 18:45:06.162222 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 18:45:06.162222 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 18:45:06.162222 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 18:45:06.162222 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 18:45:06.162222 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 18:45:06.162222 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 18:45:06.162222 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 18:45:06.162222 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 18:45:06.162222 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1513343107 could not be found. (HTTP 404) (Request-ID: req-630bff5c-2138-436f-b703-af15ea8e9428) Jun 27 18:45:06.162222 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:06.162222 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:06.162222 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:06.163484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:06.163484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 27 18:45:06.163484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 27 18:45:06.163484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 18:45:06.163484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 18:45:06.163484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 18:45:06.163484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 18:45:06.163484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 18:45:06.163484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 18:45:06.163484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 18:45:06.163484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 18:45:06.163484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 18:45:06.163484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 18:45:06.163484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 18:45:06.163484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 18:45:06.163484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 18:45:06.163484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 18:45:06.163484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 18:45:06.163484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 18:45:06.169022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 18:45:06.169022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 18:45:06.169022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 18:45:06.169022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 18:45:06.169022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1513343107 could not be found. Jun 27 18:45:06.169022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:06.169022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:06.169022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:06.169022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:06.169022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:45:06.169022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:45:06.169022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:45:06.169022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:45:06.169022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 18:45:06.169022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 18:45:06.169022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:45:06.169022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:45:06.169022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 27 18:45:06.169022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:45:06.169022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1513343107 could not be found. Jun 27 18:45:06.172607 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:06.172607 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:06.172607 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:06.172607 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:06.172607 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:45:06.172607 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:45:06.172607 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:45:06.172607 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:45:06.172607 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1513343107 could not be found. Jun 27 18:45:06.172607 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:06.172607 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-33cb08fa-9b0b-43d9-b2ab-5f92d715db40 tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] Returning 404 to user: Volume tempest-invalid-1513343107 could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:45:06.172607 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-33cb08fa-9b0b-43d9-b2ab-5f92d715db40 tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1513343107" status: 404 len: 99 microversion: 2.1 time: 0.310917 Jun 27 18:45:06.172607 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 5/6] 10.222.0.15 () {58 vars in 1217 bytes} [Mon Jun 27 18:45:05 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1513343107 => generated 99 bytes in 312 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 27 18:45:06.176741 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-831380eb-b867-45b2-a375-08eb8f2b0123 tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011248 Jun 27 18:45:06.177478 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 6/7] 10.222.0.15 () {58 vars in 1139 bytes} [Mon Jun 27 18:45:06 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 27 18:45:06.200022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-575eb1f4-48ae-45d2-a0f1-d46cf58ba4fe tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014785 Jun 27 18:45:06.201671 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 7/8] 10.222.0.15 () {58 vars in 1136 bytes} [Mon Jun 27 18:45:06 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 27 18:45:06.225960 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-567442b8-750f-48b6-9b36-5ac63fa02ba0 tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] Calling method '.version_select at 0x7f701dd2e1f0>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:06.238505 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-b067788f-0b9e-466c-9a71-6575760272ed tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.026109 Jun 27 18:45:06.242561 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 2/9] 10.222.0.15 () {60 vars in 1154 bytes} [Mon Jun 27 18:45:04 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2028 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 27 18:45:06.252168 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-9ee9613c-601c-4140-97a1-1c0c7112285a tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Calling method '.version_select at 0x7f701ddcd700>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:06.286046 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-567442b8-750f-48b6-9b36-5ac63fa02ba0 tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] HTTP exception thrown: Volume 7d824d80-3011-454d-bee6-3a98514e67f6 could not be found. Jun 27 18:45:06.292287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-567442b8-750f-48b6-9b36-5ac63fa02ba0 tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] Request method failure captured: Jun 27 18:45:06.292287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: DELETE /compute/v2.1/os-volumes/7d824d80-3011-454d-bee6-3a98514e67f6 HTTP/1.1 Jun 27 18:45:06.292287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:45:06.292287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:45:06.292287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:45:06.292287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:45:06.292287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:45:06.292287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:45:06.292287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:45:06.292287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:45:06.292287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufqvmch_LxYfAdSih9h3BFi8AK8KbwdoiiHaJrUDuJjCr0PJxOOQZ5K0oUaaFK3saHhlvqpBlsKD9DO7nuqnWziS62salUwVsyKiLK-leNApaBKUfUX6l3XFGHUkFHWvWGnTd0wgDe_Harj3Lxm0WI-gDxI3uGLwBsMG8NEGgV9uwos Jun 27 18:45:06.292287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:45:06.292287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:45:06.292287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:45:06.292287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:45:06.292287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:45:06.292287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:45:06.292287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: bcb48117fbeb47c99a3628629a66d28c Jun 27 18:45:06.292287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-VolumesNegativeTest-2025962632 Jun 27 18:45:06.292287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:45:06.292287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:45:06.293717 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bcb48117fbeb47c99a3628629a66d28c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bcb48117fbeb47c99a3628629a66d28c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bcb48117fbeb47c99a3628629a66d28c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bcb48117fbeb47c99a3628629a66d28c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:45:06.293717 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-VolumesNegativeTest-2025962632 Jun 27 18:45:06.293717 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: bcb48117fbeb47c99a3628629a66d28c Jun 27 18:45:06.293717 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-VolumesNegativeTest-2025962632 Jun 27 18:45:06.293717 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-VolumesNegativeTest-2025962632-project Jun 27 18:45:06.293717 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:45:06.293717 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:45:06.293717 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: 3502855d5bf4416997f07bb0cb39710e Jun 27 18:45:06.293717 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-VolumesNegativeTest-2025962632-project Jun 27 18:45:06.293717 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: Jun 27 18:45:06.293717 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Volume 7d824d80-3011-454d-bee6-3a98514e67f6 could not be found. Jun 27 18:45:06.293717 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': '7d824d80-3011-454d-bee6-3a98514e67f6'} Jun 27 18:45:06.293717 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:45:06.294525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:06.294525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 18:45:06.294525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 18:45:06.294525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 18:45:06.294525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 18:45:06.294525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 18:45:06.294525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 18:45:06.294525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 18:45:06.294525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 18:45:06.294525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 18:45:06.294525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 18:45:06.294525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 18:45:06.294525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 18:45:06.294525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 18:45:06.294525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 18:45:06.294525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7d824d80-3011-454d-bee6-3a98514e67f6 could not be found. (HTTP 404) (Request-ID: req-ba2acef0-ecf5-45d3-aad2-c04d6ce8de4d) Jun 27 18:45:06.294525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:06.294525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:06.294525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:06.295628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:06.295628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 27 18:45:06.295628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 27 18:45:06.295628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 18:45:06.295628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 18:45:06.295628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 18:45:06.295628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 18:45:06.295628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 18:45:06.295628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 18:45:06.295628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 18:45:06.295628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 18:45:06.295628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 18:45:06.295628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 18:45:06.295628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 18:45:06.295628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 18:45:06.295628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 18:45:06.295628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 18:45:06.295628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 18:45:06.295628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 18:45:06.297104 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 18:45:06.297104 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 18:45:06.297104 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 18:45:06.297104 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 18:45:06.297104 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7d824d80-3011-454d-bee6-3a98514e67f6 could not be found. Jun 27 18:45:06.297104 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:06.297104 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:06.297104 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:06.297104 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:06.297104 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:45:06.297104 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:45:06.297104 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:45:06.297104 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:45:06.297104 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 18:45:06.297104 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 18:45:06.297104 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:45:06.297104 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:45:06.297104 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 27 18:45:06.297104 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:45:06.298434 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7d824d80-3011-454d-bee6-3a98514e67f6 could not be found. Jun 27 18:45:06.298434 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:06.298434 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:06.298434 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:06.298434 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:06.298434 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:45:06.298434 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:45:06.298434 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:45:06.298434 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:45:06.298434 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7d824d80-3011-454d-bee6-3a98514e67f6 could not be found. Jun 27 18:45:06.298434 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:06.309637 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-567442b8-750f-48b6-9b36-5ac63fa02ba0 tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] Returning 404 to user: Volume 7d824d80-3011-454d-bee6-3a98514e67f6 could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:45:06.311988 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-567442b8-750f-48b6-9b36-5ac63fa02ba0 tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/7d824d80-3011-454d-bee6-3a98514e67f6" status: 404 len: 109 microversion: 2.1 time: 0.105808 Jun 27 18:45:06.314914 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 8/10] 10.222.0.15 () {58 vars in 1247 bytes} [Mon Jun 27 18:45:06 2022] DELETE /compute/v2.1/os-volumes/7d824d80-3011-454d-bee6-3a98514e67f6 => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:45:06.327994 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7de42bf7-3520-4e0c-bc0a-d7b9bf064fc2 tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] Calling method '.version_select at 0x7f701dddb700>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:06.345050 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-9ee9613c-601c-4140-97a1-1c0c7112285a tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/46133297-b5a1-42c9-9cbf-332e956d0b6a" status: 200 len: 344 microversion: 2.1 time: 0.097606 Jun 27 18:45:06.346046 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 3/11] 10.222.0.15 () {58 vars in 1244 bytes} [Mon Jun 27 18:45:06 2022] GET /compute/v2.1/os-volumes/46133297-b5a1-42c9-9cbf-332e956d0b6a => generated 344 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:45:06.435532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-7de42bf7-3520-4e0c-bc0a-d7b9bf064fc2 tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] HTTP exception thrown: Volume cf8d20a2-b5a0-4cdb-a105-28ac70da4308 could not be found. Jun 27 18:45:06.435532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7de42bf7-3520-4e0c-bc0a-d7b9bf064fc2 tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] Request method failure captured: Jun 27 18:45:06.435532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: GET /compute/v2.1/os-volumes/cf8d20a2-b5a0-4cdb-a105-28ac70da4308 HTTP/1.1 Jun 27 18:45:06.435532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:45:06.435532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:45:06.435532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:45:06.435532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:45:06.435532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:45:06.435532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:45:06.435532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:45:06.435532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:45:06.435532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufqvmch_LxYfAdSih9h3BFi8AK8KbwdoiiHaJrUDuJjCr0PJxOOQZ5K0oUaaFK3saHhlvqpBlsKD9DO7nuqnWziS62salUwVsyKiLK-leNApaBKUfUX6l3XFGHUkFHWvWGnTd0wgDe_Harj3Lxm0WI-gDxI3uGLwBsMG8NEGgV9uwos Jun 27 18:45:06.435532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:45:06.435532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:45:06.435532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:45:06.435532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:45:06.435532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:45:06.435532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:45:06.435532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: bcb48117fbeb47c99a3628629a66d28c Jun 27 18:45:06.435532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-VolumesNegativeTest-2025962632 Jun 27 18:45:06.435532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:45:06.435532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:45:06.437875 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bcb48117fbeb47c99a3628629a66d28c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bcb48117fbeb47c99a3628629a66d28c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bcb48117fbeb47c99a3628629a66d28c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bcb48117fbeb47c99a3628629a66d28c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:45:06.437875 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-VolumesNegativeTest-2025962632 Jun 27 18:45:06.437875 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: bcb48117fbeb47c99a3628629a66d28c Jun 27 18:45:06.437875 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-VolumesNegativeTest-2025962632 Jun 27 18:45:06.437875 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-VolumesNegativeTest-2025962632-project Jun 27 18:45:06.437875 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:45:06.437875 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:45:06.437875 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: 3502855d5bf4416997f07bb0cb39710e Jun 27 18:45:06.437875 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-VolumesNegativeTest-2025962632-project Jun 27 18:45:06.437875 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: Jun 27 18:45:06.437875 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Volume cf8d20a2-b5a0-4cdb-a105-28ac70da4308 could not be found. Jun 27 18:45:06.437875 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': 'cf8d20a2-b5a0-4cdb-a105-28ac70da4308'} Jun 27 18:45:06.437875 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:45:06.438923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:06.438923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 18:45:06.438923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 18:45:06.438923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 18:45:06.438923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 18:45:06.438923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 18:45:06.438923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 18:45:06.438923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 18:45:06.438923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 18:45:06.438923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 18:45:06.438923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 18:45:06.438923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 18:45:06.438923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 18:45:06.438923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 18:45:06.438923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 18:45:06.438923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cf8d20a2-b5a0-4cdb-a105-28ac70da4308 could not be found. (HTTP 404) (Request-ID: req-9214c63a-88bf-455e-aad9-744fe0472c7a) Jun 27 18:45:06.438923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:06.438923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:06.438923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:06.440403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:06.440403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 18:45:06.440403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 18:45:06.440403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 18:45:06.440403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 18:45:06.440403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 18:45:06.440403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 18:45:06.440403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 18:45:06.440403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 18:45:06.440403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 18:45:06.440403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 18:45:06.440403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 18:45:06.440403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 18:45:06.440403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 18:45:06.440403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 18:45:06.440403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 18:45:06.440403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 18:45:06.440403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 18:45:06.440403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 18:45:06.441731 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 18:45:06.441731 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 18:45:06.441731 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 18:45:06.441731 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 18:45:06.441731 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cf8d20a2-b5a0-4cdb-a105-28ac70da4308 could not be found. Jun 27 18:45:06.441731 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:06.441731 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:06.441731 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:06.441731 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:06.441731 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:45:06.441731 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:45:06.441731 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:45:06.441731 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:45:06.441731 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 18:45:06.441731 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 18:45:06.441731 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:45:06.441731 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:45:06.441731 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 18:45:06.441731 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:45:06.443180 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cf8d20a2-b5a0-4cdb-a105-28ac70da4308 could not be found. Jun 27 18:45:06.443180 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:06.443180 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:06.443180 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:06.443180 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:06.443180 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:45:06.443180 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:45:06.443180 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:45:06.443180 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:45:06.443180 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cf8d20a2-b5a0-4cdb-a105-28ac70da4308 could not be found. Jun 27 18:45:06.443180 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:06.443180 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7de42bf7-3520-4e0c-bc0a-d7b9bf064fc2 tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] Returning 404 to user: Volume cf8d20a2-b5a0-4cdb-a105-28ac70da4308 could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:45:06.443180 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-7de42bf7-3520-4e0c-bc0a-d7b9bf064fc2 tempest-VolumesNegativeTest-2025962632 tempest-VolumesNegativeTest-2025962632-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/cf8d20a2-b5a0-4cdb-a105-28ac70da4308" status: 404 len: 109 microversion: 2.1 time: 0.100345 Jun 27 18:45:06.443180 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 9/12] 10.222.0.15 () {58 vars in 1244 bytes} [Mon Jun 27 18:45:06 2022] GET /compute/v2.1/os-volumes/cf8d20a2-b5a0-4cdb-a105-28ac70da4308 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:45:06.836444 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-686b2759-4956-4311-b7a6-9d6ebb4c4424 tempest-VolumesGetTestJSON-135348371 tempest-VolumesGetTestJSON-135348371-project] Calling method '.version_select at 0x7f701ddcddc0>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:06.908962 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-686b2759-4956-4311-b7a6-9d6ebb4c4424 tempest-VolumesGetTestJSON-135348371 tempest-VolumesGetTestJSON-135348371-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/6689bd92-0071-499a-a0b6-9925aa986483" status: 200 len: 353 microversion: 2.1 time: 0.076160 Jun 27 18:45:06.914518 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 4/13] 10.222.0.15 () {58 vars in 1244 bytes} [Mon Jun 27 18:45:06 2022] GET /compute/v2.1/os-volumes/6689bd92-0071-499a-a0b6-9925aa986483 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:45:06.925331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-14aec1ab-4953-46f1-9a31-11ccb9dd4c91 tempest-VolumesGetTestJSON-135348371 tempest-VolumesGetTestJSON-135348371-project] Calling method '.version_select at 0x7f701dd2eaf0>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:07.010598 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-14aec1ab-4953-46f1-9a31-11ccb9dd4c91 tempest-VolumesGetTestJSON-135348371 tempest-VolumesGetTestJSON-135348371-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/6689bd92-0071-499a-a0b6-9925aa986483" status: 200 len: 353 microversion: 2.1 time: 0.091406 Jun 27 18:45:07.023130 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 10/14] 10.222.0.15 () {58 vars in 1244 bytes} [Mon Jun 27 18:45:06 2022] GET /compute/v2.1/os-volumes/6689bd92-0071-499a-a0b6-9925aa986483 => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:45:07.031759 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e104e076-7972-4eb1-bd3a-bdfaffc80465 tempest-VolumesGetTestJSON-135348371 tempest-VolumesGetTestJSON-135348371-project] Calling method '.version_select at 0x7f701dddb550>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:07.337993 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e104e076-7972-4eb1-bd3a-bdfaffc80465 tempest-VolumesGetTestJSON-135348371 tempest-VolumesGetTestJSON-135348371-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/6689bd92-0071-499a-a0b6-9925aa986483" status: 202 len: 0 microversion: 2.1 time: 0.309869 Jun 27 18:45:07.339282 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 5/15] 10.222.0.15 () {58 vars in 1247 bytes} [Mon Jun 27 18:45:07 2022] DELETE /compute/v2.1/os-volumes/6689bd92-0071-499a-a0b6-9925aa986483 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:45:07.346824 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-3423c47b-7f65-4c92-8a8c-fe5e87e98346 tempest-VolumesGetTestJSON-135348371 tempest-VolumesGetTestJSON-135348371-project] Calling method '.version_select at 0x7f701dddb550>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:07.360528 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-b63c7ad9-7ce5-4cef-bc11-a3a237b60a24 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Calling method '.version_select at 0x7f701ddcdd30>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:07.443055 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-b63c7ad9-7ce5-4cef-bc11-a3a237b60a24 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/46133297-b5a1-42c9-9cbf-332e956d0b6a" status: 200 len: 345 microversion: 2.1 time: 0.088811 Jun 27 18:45:07.444578 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 6/16] 10.222.0.15 () {58 vars in 1244 bytes} [Mon Jun 27 18:45:07 2022] GET /compute/v2.1/os-volumes/46133297-b5a1-42c9-9cbf-332e956d0b6a => generated 345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:45:07.454699 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-3423c47b-7f65-4c92-8a8c-fe5e87e98346 tempest-VolumesGetTestJSON-135348371 tempest-VolumesGetTestJSON-135348371-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/6689bd92-0071-499a-a0b6-9925aa986483" status: 200 len: 352 microversion: 2.1 time: 0.111545 Jun 27 18:45:07.456819 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 11/17] 10.222.0.15 () {58 vars in 1244 bytes} [Mon Jun 27 18:45:07 2022] GET /compute/v2.1/os-volumes/6689bd92-0071-499a-a0b6-9925aa986483 => generated 352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:45:07.463706 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-c74d488e-d2fc-4ed3-bfc6-6038c9520b17 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Action: 'create', calling method: .version_select at 0x7f701ddcd700>, body: {"snapshot": {"volume_id": "46133297-b5a1-42c9-9cbf-332e956d0b6a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-754933545"}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:45:08.437491 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-c74d488e-d2fc-4ed3-bfc6-6038c9520b17 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.985387 Jun 27 18:45:08.438589 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 7/18] 10.222.0.15 () {60 vars in 1161 bytes} [Mon Jun 27 18:45:07 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:45:08.449582 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-c9ea66af-84d3-4a37-8251-bfcc0c6e8391 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Calling method '.version_select at 0x7f701dd2e310>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:08.472672 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-5621cdf1-f4ec-44f1-b724-0f855850cb9e tempest-VolumesGetTestJSON-135348371 tempest-VolumesGetTestJSON-135348371-project] Calling method '.version_select at 0x7f701dddbaf0>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:08.548019 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-c9ea66af-84d3-4a37-8251-bfcc0c6e8391 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/73386417-5f82-4881-af71-57f7477bdc2c" status: 200 len: 286 microversion: 2.1 time: 0.103075 Jun 27 18:45:08.548602 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 12/19] 10.222.0.15 () {58 vars in 1250 bytes} [Mon Jun 27 18:45:08 2022] GET /compute/v2.1/os-snapshots/73386417-5f82-4881-af71-57f7477bdc2c => generated 286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:45:08.560172 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-9cdddd79-8f50-433e-b0d2-be3705224531 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Calling method '.version_select at 0x7f701dd2e040>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:08.604748 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-5621cdf1-f4ec-44f1-b724-0f855850cb9e tempest-VolumesGetTestJSON-135348371 tempest-VolumesGetTestJSON-135348371-project] HTTP exception thrown: Volume 6689bd92-0071-499a-a0b6-9925aa986483 could not be found. Jun 27 18:45:08.610366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-5621cdf1-f4ec-44f1-b724-0f855850cb9e tempest-VolumesGetTestJSON-135348371 tempest-VolumesGetTestJSON-135348371-project] Request method failure captured: Jun 27 18:45:08.610366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: GET /compute/v2.1/os-volumes/6689bd92-0071-499a-a0b6-9925aa986483 HTTP/1.1 Jun 27 18:45:08.610366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 18:45:08.610366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 18:45:08.610366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 18:45:08.610366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 0 Jun 27 18:45:08.610366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 18:45:08.610366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 18:45:08.610366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 18:45:08.610366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 18:45:08.610366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufqtQdNxwOY5BXpj7wYnejca_uiUz1j3_gW9ldKvzX5QZaYO0SmTaHB4nab5gVvicT4CHgCAF_KXxkbGWvBSxn_eaLnSkBUEA9QVZTrphbThUFabYORqOcyLB17YamPBSIzEy9-SExsXal0VMv0J4Ri2WSOAunBOPSdhw7hi20oKy0E Jun 27 18:45:08.610366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 18:45:08.610366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 18:45:08.610366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 18:45:08.610366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 18:45:08.610366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 18:45:08.610366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 18:45:08.610366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: 87d136c3a8674786a29c2622dfca33e9 Jun 27 18:45:08.610366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-VolumesGetTestJSON-135348371 Jun 27 18:45:08.610366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 18:45:08.610366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 18:45:08.611578 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/87d136c3a8674786a29c2622dfca33e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/87d136c3a8674786a29c2622dfca33e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_87d136c3a8674786a29c2622dfca33e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/87d136c3a8674786a29c2622dfca33e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:45:08.611578 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-VolumesGetTestJSON-135348371 Jun 27 18:45:08.611578 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: 87d136c3a8674786a29c2622dfca33e9 Jun 27 18:45:08.611578 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-VolumesGetTestJSON-135348371 Jun 27 18:45:08.611578 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-VolumesGetTestJSON-135348371-project Jun 27 18:45:08.611578 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 18:45:08.611578 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 18:45:08.611578 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: 02865be1eeaa404eabac7612bd86c9d1 Jun 27 18:45:08.611578 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-VolumesGetTestJSON-135348371-project Jun 27 18:45:08.611578 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: Jun 27 18:45:08.611578 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Volume 6689bd92-0071-499a-a0b6-9925aa986483 could not be found. Jun 27 18:45:08.611578 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'id': '6689bd92-0071-499a-a0b6-9925aa986483'} Jun 27 18:45:08.611578 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:45:08.612344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:08.612344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 18:45:08.612344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 18:45:08.612344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 18:45:08.612344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 18:45:08.612344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 18:45:08.612344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 18:45:08.612344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 18:45:08.612344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 18:45:08.612344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 18:45:08.612344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 18:45:08.612344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 18:45:08.612344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 18:45:08.612344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 18:45:08.612344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 18:45:08.612344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6689bd92-0071-499a-a0b6-9925aa986483 could not be found. (HTTP 404) (Request-ID: req-19ff1633-6ba1-4d91-8962-a4c0e6ae5cfb) Jun 27 18:45:08.612344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:45:08.612344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:08.612344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:45:08.613288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:08.613288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 18:45:08.613288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 18:45:08.613288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 18:45:08.613288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 18:45:08.613288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 18:45:08.613288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 18:45:08.613288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 18:45:08.613288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 18:45:08.613288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 18:45:08.613288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 18:45:08.613288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 18:45:08.613288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 18:45:08.613288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 18:45:08.613288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 18:45:08.613288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 18:45:08.613288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 18:45:08.613288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 18:45:08.613288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 18:45:08.614160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 18:45:08.614160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 18:45:08.614160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 18:45:08.614160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 18:45:08.614160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6689bd92-0071-499a-a0b6-9925aa986483 could not be found. Jun 27 18:45:08.614160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:45:08.614160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:08.614160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:45:08.614160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:08.614160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:45:08.614160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:45:08.614160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:45:08.614160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:45:08.614160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 18:45:08.614160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 18:45:08.614160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:45:08.614160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:45:08.614160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 18:45:08.614160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:45:08.615377 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6689bd92-0071-499a-a0b6-9925aa986483 could not be found. Jun 27 18:45:08.615377 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:45:08.615377 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:08.615377 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:45:08.615377 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:08.615377 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:45:08.615377 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:45:08.615377 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:45:08.615377 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:45:08.615377 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6689bd92-0071-499a-a0b6-9925aa986483 could not be found. Jun 27 18:45:08.615377 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:45:08.619776 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-5621cdf1-f4ec-44f1-b724-0f855850cb9e tempest-VolumesGetTestJSON-135348371 tempest-VolumesGetTestJSON-135348371-project] Returning 404 to user: Volume 6689bd92-0071-499a-a0b6-9925aa986483 could not be found. {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:45:08.621872 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-5621cdf1-f4ec-44f1-b724-0f855850cb9e tempest-VolumesGetTestJSON-135348371 tempest-VolumesGetTestJSON-135348371-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/6689bd92-0071-499a-a0b6-9925aa986483" status: 404 len: 109 microversion: 2.1 time: 0.153578 Jun 27 18:45:08.623049 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 8/20] 10.222.0.15 () {58 vars in 1244 bytes} [Mon Jun 27 18:45:08 2022] GET /compute/v2.1/os-volumes/6689bd92-0071-499a-a0b6-9925aa986483 => generated 109 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 18:45:08.920716 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-9cdddd79-8f50-433e-b0d2-be3705224531 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.365732 Jun 27 18:45:08.921280 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 13/21] 10.222.0.15 () {58 vars in 1139 bytes} [Mon Jun 27 18:45:08 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:45:08.932996 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-81ebfca5-9e5c-4a76-aa22-a50b362d68bb tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Calling method '.version_select at 0x7f701dddb820>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:08.981851 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-81ebfca5-9e5c-4a76-aa22-a50b362d68bb tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/73386417-5f82-4881-af71-57f7477bdc2c" status: 200 len: 286 microversion: 2.1 time: 0.052871 Jun 27 18:45:08.982440 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 9/22] 10.222.0.15 () {58 vars in 1250 bytes} [Mon Jun 27 18:45:08 2022] GET /compute/v2.1/os-snapshots/73386417-5f82-4881-af71-57f7477bdc2c => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:45:09.996955 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-2915e374-6de6-4e1c-81ce-f36472813ca9 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Calling method '.version_select at 0x7f701dd2e8b0>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:10.541619 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-2915e374-6de6-4e1c-81ce-f36472813ca9 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/73386417-5f82-4881-af71-57f7477bdc2c" status: 200 len: 286 microversion: 2.1 time: 0.551280 Jun 27 18:45:10.543119 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 14/23] 10.222.0.15 () {58 vars in 1250 bytes} [Mon Jun 27 18:45:09 2022] GET /compute/v2.1/os-snapshots/73386417-5f82-4881-af71-57f7477bdc2c => generated 286 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:45:11.559008 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-9b8ac92d-b153-441b-b6eb-62cb82248103 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Calling method '.version_select at 0x7f701dd304c0>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:11.609179 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-9b8ac92d-b153-441b-b6eb-62cb82248103 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/73386417-5f82-4881-af71-57f7477bdc2c" status: 200 len: 286 microversion: 2.1 time: 0.059962 Jun 27 18:45:11.610450 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 10/24] 10.222.0.15 () {58 vars in 1250 bytes} [Mon Jun 27 18:45:11 2022] GET /compute/v2.1/os-snapshots/73386417-5f82-4881-af71-57f7477bdc2c => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:45:12.628925 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-5181fe17-bf5c-416a-995d-4abfa5c03bf0 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Calling method '.version_select at 0x7f701de23280>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:12.698571 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-5181fe17-bf5c-416a-995d-4abfa5c03bf0 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/73386417-5f82-4881-af71-57f7477bdc2c" status: 200 len: 287 microversion: 2.1 time: 0.074808 Jun 27 18:45:12.699136 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 15/25] 10.222.0.15 () {58 vars in 1250 bytes} [Mon Jun 27 18:45:12 2022] GET /compute/v2.1/os-snapshots/73386417-5f82-4881-af71-57f7477bdc2c => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:45:12.710640 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-f02831b7-bf30-403f-b673-38d81a4c2ee8 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Calling method '.version_select at 0x7f701dddb430>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:12.940134 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-f02831b7-bf30-403f-b673-38d81a4c2ee8 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/73386417-5f82-4881-af71-57f7477bdc2c" status: 202 len: 0 microversion: 2.1 time: 0.233320 Jun 27 18:45:12.948840 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 11/26] 10.222.0.15 () {58 vars in 1253 bytes} [Mon Jun 27 18:45:12 2022] DELETE /compute/v2.1/os-snapshots/73386417-5f82-4881-af71-57f7477bdc2c => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:45:12.959357 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7d73a326-b758-46ab-8426-bb424dd8ca3d tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Calling method '.version_select at 0x7f701dddb820>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:13.041038 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-7d73a326-b758-46ab-8426-bb424dd8ca3d tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/73386417-5f82-4881-af71-57f7477bdc2c" status: 200 len: 286 microversion: 2.1 time: 0.094516 Jun 27 18:45:13.045451 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 16/27] 10.222.0.15 () {58 vars in 1250 bytes} [Mon Jun 27 18:45:12 2022] GET /compute/v2.1/os-snapshots/73386417-5f82-4881-af71-57f7477bdc2c => generated 286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:45:14.062258 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f23eb622-b23f-4b94-ab6c-ab413f1fc3c4 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Calling method '.version_select at 0x7f701dddb430>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:14.119528 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-f23eb622-b23f-4b94-ab6c-ab413f1fc3c4 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] HTTP exception thrown: Snapshot 73386417-5f82-4881-af71-57f7477bdc2c could not be found. Jun 27 18:45:14.140261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f23eb622-b23f-4b94-ab6c-ab413f1fc3c4 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Request method failure captured: Jun 27 18:45:14.140261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: GET /compute/v2.1/os-snapshots/73386417-5f82-4881-af71-57f7477bdc2c HTTP/1.1 Jun 27 18:45:14.140261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:45:14.140261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:45:14.140261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:45:14.140261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:45:14.140261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:45:14.140261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:45:14.140261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:45:14.140261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:45:14.140261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufqvIxLZ4fgocj_CPRKfD9yCAvi0TNQMRujEfhKccSwIKJ4JVRbZAPSlI3vexLWamSEFIRAbnCKVB4yvO5uv-IcMGJwxsIpMkrMgh2-hAAtHRv1cnWBlbRlIHr-alSdO6SlHxRl4XvpUFmhRfQ5QwDMXtmAfHeVdylQ-msqSXPjor6I Jun 27 18:45:14.140261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:45:14.140261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:45:14.140261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:45:14.140261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:45:14.140261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:45:14.140261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:45:14.140261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: be721490bd6c4084a7d13c39a92e0c05 Jun 27 18:45:14.140261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1691193192 Jun 27 18:45:14.140261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:45:14.140261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:45:14.141566 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/be721490bd6c4084a7d13c39a92e0c05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/be721490bd6c4084a7d13c39a92e0c05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_be721490bd6c4084a7d13c39a92e0c05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/be721490bd6c4084a7d13c39a92e0c05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:45:14.141566 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1691193192 Jun 27 18:45:14.141566 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: be721490bd6c4084a7d13c39a92e0c05 Jun 27 18:45:14.141566 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1691193192 Jun 27 18:45:14.141566 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-VolumesSnapshotsTestJSON-1691193192-project Jun 27 18:45:14.141566 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:45:14.141566 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:45:14.141566 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: e9ce0fe01f5b46b29b9c5a28ca31ac70 Jun 27 18:45:14.141566 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1691193192-project Jun 27 18:45:14.141566 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: Jun 27 18:45:14.141566 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Snapshot 73386417-5f82-4881-af71-57f7477bdc2c could not be found. Jun 27 18:45:14.141566 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': '73386417-5f82-4881-af71-57f7477bdc2c'} Jun 27 18:45:14.141566 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:45:14.142330 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:14.142330 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 27 18:45:14.142330 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 27 18:45:14.142330 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 27 18:45:14.142330 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 27 18:45:14.142330 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 27 18:45:14.142330 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 27 18:45:14.142330 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 18:45:14.142330 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 18:45:14.142330 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 18:45:14.142330 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 18:45:14.142330 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 18:45:14.142330 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 18:45:14.142330 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 18:45:14.142330 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 18:45:14.142330 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 73386417-5f82-4881-af71-57f7477bdc2c could not be found. (HTTP 404) (Request-ID: req-7e500c91-dca9-453f-96b1-539e74ec1d78) Jun 27 18:45:14.142330 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:14.142330 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:14.143504 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:14.143504 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:14.143504 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 27 18:45:14.143504 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 27 18:45:14.143504 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 18:45:14.143504 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 18:45:14.143504 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 27 18:45:14.143504 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 27 18:45:14.143504 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 18:45:14.143504 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 18:45:14.143504 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 27 18:45:14.143504 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 27 18:45:14.143504 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 27 18:45:14.143504 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 27 18:45:14.143504 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 27 18:45:14.143504 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 27 18:45:14.143504 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 18:45:14.143504 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 18:45:14.143504 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 18:45:14.144521 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 18:45:14.144521 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 18:45:14.144521 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 18:45:14.144521 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 18:45:14.144521 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 18:45:14.144521 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 73386417-5f82-4881-af71-57f7477bdc2c could not be found. Jun 27 18:45:14.144521 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:14.144521 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:14.144521 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:14.144521 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:14.144521 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:45:14.144521 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:45:14.144521 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:45:14.144521 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:45:14.144521 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 18:45:14.144521 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 18:45:14.144521 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:45:14.144521 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:45:14.144521 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 27 18:45:14.144521 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:45:14.145494 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 73386417-5f82-4881-af71-57f7477bdc2c could not be found. Jun 27 18:45:14.145494 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:14.145494 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:14.145494 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:14.145494 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:14.145494 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:45:14.145494 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:45:14.145494 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:45:14.145494 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:45:14.145494 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 73386417-5f82-4881-af71-57f7477bdc2c could not be found. Jun 27 18:45:14.145494 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:14.155179 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f23eb622-b23f-4b94-ab6c-ab413f1fc3c4 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Returning 404 to user: Snapshot 73386417-5f82-4881-af71-57f7477bdc2c could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:45:14.157635 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f23eb622-b23f-4b94-ab6c-ab413f1fc3c4 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/73386417-5f82-4881-af71-57f7477bdc2c" status: 404 len: 111 microversion: 2.1 time: 0.107740 Jun 27 18:45:14.158765 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 17/28] 10.222.0.15 () {58 vars in 1250 bytes} [Mon Jun 27 18:45:14 2022] GET /compute/v2.1/os-snapshots/73386417-5f82-4881-af71-57f7477bdc2c => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:45:14.189291 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-df4899b0-bd9f-48ef-8838-34d78f4b31d9 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Calling method '.version_select at 0x7f701dddb790>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:14.458390 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-df4899b0-bd9f-48ef-8838-34d78f4b31d9 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/46133297-b5a1-42c9-9cbf-332e956d0b6a" status: 202 len: 0 microversion: 2.1 time: 0.287589 Jun 27 18:45:14.459525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 18/29] 10.222.0.15 () {58 vars in 1247 bytes} [Mon Jun 27 18:45:14 2022] DELETE /compute/v2.1/os-volumes/46133297-b5a1-42c9-9cbf-332e956d0b6a => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:45:14.470347 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-21ca42ee-7f69-429b-aed9-25a5b99d7d6d tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Calling method '.version_select at 0x7f701dd2e5e0>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:14.549901 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-674aa92f-4d21-44a1-a9dd-e9705c4b7e5b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Action: 'create', calling method: .version_select at 0x7f701dddb790>, body: {"keypair": {"name": "tempest-keypair-1722412099", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7t9NlcEum92UJCHjmsMqhyWKgoJUHQtAy394e/WH0QQk+znqB2tMak+gIQvYCqVpOAz/xVEHqyrzxhoEbhsYQ018HdWnh6HIhoig0aneCJ8L+AaiF2I/hHLufXR47UjQ=="}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:45:14.564325 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-21ca42ee-7f69-429b-aed9-25a5b99d7d6d tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/46133297-b5a1-42c9-9cbf-332e956d0b6a" status: 200 len: 344 microversion: 2.1 time: 0.100429 Jun 27 18:45:14.565254 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 19/30] 10.222.0.15 () {58 vars in 1244 bytes} [Mon Jun 27 18:45:14 2022] GET /compute/v2.1/os-volumes/46133297-b5a1-42c9-9cbf-332e956d0b6a => generated 344 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:45:14.621558 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-674aa92f-4d21-44a1-a9dd-e9705c4b7e5b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Getting quotas for project 0f19df10a9c948ce9c2e0dfa29532e5a. Resources: {'key_pairs'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:45:14.630156 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-674aa92f-4d21-44a1-a9dd-e9705c4b7e5b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Getting quotas for user 2fc6711e48be4d4ab33695e06c7227ab and project 0f19df10a9c948ce9c2e0dfa29532e5a. Resources: {'key_pairs'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:45:14.861827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-674aa92f-4d21-44a1-a9dd-e9705c4b7e5b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.870417 Jun 27 18:45:14.861827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 12/31] 10.222.0.15 () {60 vars in 1158 bytes} [Mon Jun 27 18:45:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:45:15.576402 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-3327080c-b58d-4b6a-a6ae-cb4eac932850 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Calling method '.version_select at 0x7f701dd2eb80>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:15.617831 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-3327080c-b58d-4b6a-a6ae-cb4eac932850 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] HTTP exception thrown: Volume 46133297-b5a1-42c9-9cbf-332e956d0b6a could not be found. Jun 27 18:45:15.620788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-3327080c-b58d-4b6a-a6ae-cb4eac932850 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Request method failure captured: Jun 27 18:45:15.620788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: GET /compute/v2.1/os-volumes/46133297-b5a1-42c9-9cbf-332e956d0b6a HTTP/1.1 Jun 27 18:45:15.620788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:45:15.620788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:45:15.620788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:45:15.620788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:45:15.620788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:45:15.620788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:45:15.620788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:45:15.620788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:45:15.620788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufqvIxLZ4fgocj_CPRKfD9yCAvi0TNQMRujEfhKccSwIKJ4JVRbZAPSlI3vexLWamSEFIRAbnCKVB4yvO5uv-IcMGJwxsIpMkrMgh2-hAAtHRv1cnWBlbRlIHr-alSdO6SlHxRl4XvpUFmhRfQ5QwDMXtmAfHeVdylQ-msqSXPjor6I Jun 27 18:45:15.620788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:45:15.620788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:45:15.620788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:45:15.620788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:45:15.620788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:45:15.620788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:45:15.620788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: be721490bd6c4084a7d13c39a92e0c05 Jun 27 18:45:15.620788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1691193192 Jun 27 18:45:15.620788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:45:15.620788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:45:15.621861 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/be721490bd6c4084a7d13c39a92e0c05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/be721490bd6c4084a7d13c39a92e0c05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_be721490bd6c4084a7d13c39a92e0c05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/be721490bd6c4084a7d13c39a92e0c05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:45:15.621861 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1691193192 Jun 27 18:45:15.621861 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: be721490bd6c4084a7d13c39a92e0c05 Jun 27 18:45:15.621861 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1691193192 Jun 27 18:45:15.621861 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-VolumesSnapshotsTestJSON-1691193192-project Jun 27 18:45:15.621861 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:45:15.621861 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:45:15.621861 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: e9ce0fe01f5b46b29b9c5a28ca31ac70 Jun 27 18:45:15.621861 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1691193192-project Jun 27 18:45:15.621861 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: Jun 27 18:45:15.621861 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Volume 46133297-b5a1-42c9-9cbf-332e956d0b6a could not be found. Jun 27 18:45:15.621861 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': '46133297-b5a1-42c9-9cbf-332e956d0b6a'} Jun 27 18:45:15.621861 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:45:15.622562 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:15.622562 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 18:45:15.622562 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 18:45:15.622562 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 18:45:15.622562 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 18:45:15.622562 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 18:45:15.622562 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 18:45:15.622562 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 18:45:15.622562 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 18:45:15.622562 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 18:45:15.622562 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 18:45:15.622562 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 18:45:15.622562 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 18:45:15.622562 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 18:45:15.622562 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 18:45:15.622562 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 46133297-b5a1-42c9-9cbf-332e956d0b6a could not be found. (HTTP 404) (Request-ID: req-85c1c6b5-671f-463a-b34c-cfd65f33f05f) Jun 27 18:45:15.622562 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:15.622562 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:15.622562 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:15.623770 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:15.623770 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 18:45:15.623770 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 18:45:15.623770 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 18:45:15.623770 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 18:45:15.623770 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 18:45:15.623770 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 18:45:15.623770 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 18:45:15.623770 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 18:45:15.623770 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 18:45:15.623770 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 18:45:15.623770 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 18:45:15.623770 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 18:45:15.623770 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 18:45:15.623770 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 18:45:15.623770 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 18:45:15.623770 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 18:45:15.623770 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 18:45:15.623770 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 18:45:15.624664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 18:45:15.624664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 18:45:15.624664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 18:45:15.624664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 18:45:15.624664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 46133297-b5a1-42c9-9cbf-332e956d0b6a could not be found. Jun 27 18:45:15.624664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:15.624664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:15.624664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:15.624664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:15.624664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:45:15.624664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:45:15.624664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:45:15.624664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:45:15.624664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 18:45:15.624664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 18:45:15.624664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:45:15.624664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:45:15.624664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 18:45:15.624664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:45:15.625674 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 46133297-b5a1-42c9-9cbf-332e956d0b6a could not be found. Jun 27 18:45:15.625674 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:15.625674 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:15.625674 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:15.625674 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:15.625674 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:45:15.625674 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:45:15.625674 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:45:15.625674 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:45:15.625674 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 46133297-b5a1-42c9-9cbf-332e956d0b6a could not be found. Jun 27 18:45:15.625674 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:15.628084 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-3327080c-b58d-4b6a-a6ae-cb4eac932850 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Returning 404 to user: Volume 46133297-b5a1-42c9-9cbf-332e956d0b6a could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:45:15.629852 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-3327080c-b58d-4b6a-a6ae-cb4eac932850 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/46133297-b5a1-42c9-9cbf-332e956d0b6a" status: 404 len: 109 microversion: 2.1 time: 0.057700 Jun 27 18:45:15.631043 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 20/32] 10.222.0.15 () {58 vars in 1244 bytes} [Mon Jun 27 18:45:15 2022] GET /compute/v2.1/os-volumes/46133297-b5a1-42c9-9cbf-332e956d0b6a => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:45:15.643002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-43b8f4ef-8463-41b5-bd06-86950df0f997 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Calling method '.version_select at 0x7f701dcf8c10>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:15.691610 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-43b8f4ef-8463-41b5-bd06-86950df0f997 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] HTTP exception thrown: Volume 46133297-b5a1-42c9-9cbf-332e956d0b6a could not be found. Jun 27 18:45:15.693964 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-43b8f4ef-8463-41b5-bd06-86950df0f997 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Request method failure captured: Jun 27 18:45:15.693964 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: DELETE /compute/v2.1/os-volumes/46133297-b5a1-42c9-9cbf-332e956d0b6a HTTP/1.1 Jun 27 18:45:15.693964 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 18:45:15.693964 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 18:45:15.693964 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 18:45:15.693964 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 0 Jun 27 18:45:15.693964 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 18:45:15.693964 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 18:45:15.693964 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 18:45:15.693964 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 18:45:15.693964 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufqvIxLZ4fgocj_CPRKfD9yCAvi0TNQMRujEfhKccSwIKJ4JVRbZAPSlI3vexLWamSEFIRAbnCKVB4yvO5uv-IcMGJwxsIpMkrMgh2-hAAtHRv1cnWBlbRlIHr-alSdO6SlHxRl4XvpUFmhRfQ5QwDMXtmAfHeVdylQ-msqSXPjor6I Jun 27 18:45:15.693964 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 18:45:15.693964 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 18:45:15.693964 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 18:45:15.693964 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 18:45:15.693964 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 18:45:15.693964 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 18:45:15.693964 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: be721490bd6c4084a7d13c39a92e0c05 Jun 27 18:45:15.693964 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1691193192 Jun 27 18:45:15.693964 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 18:45:15.693964 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 18:45:15.695013 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/be721490bd6c4084a7d13c39a92e0c05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/be721490bd6c4084a7d13c39a92e0c05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_be721490bd6c4084a7d13c39a92e0c05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/be721490bd6c4084a7d13c39a92e0c05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:45:15.695013 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1691193192 Jun 27 18:45:15.695013 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: be721490bd6c4084a7d13c39a92e0c05 Jun 27 18:45:15.695013 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1691193192 Jun 27 18:45:15.695013 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-VolumesSnapshotsTestJSON-1691193192-project Jun 27 18:45:15.695013 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 18:45:15.695013 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 18:45:15.695013 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: e9ce0fe01f5b46b29b9c5a28ca31ac70 Jun 27 18:45:15.695013 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1691193192-project Jun 27 18:45:15.695013 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: Jun 27 18:45:15.695013 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Volume 46133297-b5a1-42c9-9cbf-332e956d0b6a could not be found. Jun 27 18:45:15.695013 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'id': '46133297-b5a1-42c9-9cbf-332e956d0b6a'} Jun 27 18:45:15.695013 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:45:15.695624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:15.695624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 18:45:15.695624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 18:45:15.695624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 18:45:15.695624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 18:45:15.695624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 18:45:15.695624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 18:45:15.695624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 18:45:15.695624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 18:45:15.695624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 18:45:15.695624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 18:45:15.695624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 18:45:15.695624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 18:45:15.695624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 18:45:15.695624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 18:45:15.695624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 46133297-b5a1-42c9-9cbf-332e956d0b6a could not be found. (HTTP 404) (Request-ID: req-70ddba03-ae90-4631-b27d-646b35778c0a) Jun 27 18:45:15.695624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:45:15.695624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:15.695624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:45:15.696599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:15.696599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 27 18:45:15.696599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 27 18:45:15.696599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 18:45:15.696599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 18:45:15.696599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 18:45:15.696599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 18:45:15.696599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 18:45:15.696599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 18:45:15.696599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 18:45:15.696599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 18:45:15.696599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 18:45:15.696599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 18:45:15.696599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 18:45:15.696599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 18:45:15.696599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 18:45:15.696599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 18:45:15.696599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 18:45:15.696599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 18:45:15.697474 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 18:45:15.697474 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 18:45:15.697474 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 18:45:15.697474 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 18:45:15.697474 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 46133297-b5a1-42c9-9cbf-332e956d0b6a could not be found. Jun 27 18:45:15.697474 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:45:15.697474 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:15.697474 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:45:15.697474 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:15.697474 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:45:15.697474 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:45:15.697474 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:45:15.697474 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:45:15.697474 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 18:45:15.697474 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 18:45:15.697474 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:45:15.697474 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:45:15.697474 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 27 18:45:15.697474 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:45:15.698346 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 46133297-b5a1-42c9-9cbf-332e956d0b6a could not be found. Jun 27 18:45:15.698346 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:45:15.698346 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:15.698346 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:45:15.698346 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:15.698346 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:45:15.698346 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:45:15.698346 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:45:15.698346 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:45:15.698346 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 46133297-b5a1-42c9-9cbf-332e956d0b6a could not be found. Jun 27 18:45:15.698346 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:45:15.701105 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-43b8f4ef-8463-41b5-bd06-86950df0f997 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Returning 404 to user: Volume 46133297-b5a1-42c9-9cbf-332e956d0b6a could not be found. {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:45:15.702066 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-43b8f4ef-8463-41b5-bd06-86950df0f997 tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/46133297-b5a1-42c9-9cbf-332e956d0b6a" status: 404 len: 109 microversion: 2.1 time: 0.064002 Jun 27 18:45:15.703278 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 13/33] 10.222.0.15 () {58 vars in 1247 bytes} [Mon Jun 27 18:45:15 2022] DELETE /compute/v2.1/os-volumes/46133297-b5a1-42c9-9cbf-332e956d0b6a => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:45:15.718636 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-2d174aee-9a1f-460f-be74-206efbf90e0d tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Calling method '.version_select at 0x7f701de23280>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:15.752986 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-2d174aee-9a1f-460f-be74-206efbf90e0d tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] HTTP exception thrown: Volume 46133297-b5a1-42c9-9cbf-332e956d0b6a could not be found. Jun 27 18:45:15.755201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-2d174aee-9a1f-460f-be74-206efbf90e0d tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Request method failure captured: Jun 27 18:45:15.755201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: GET /compute/v2.1/os-volumes/46133297-b5a1-42c9-9cbf-332e956d0b6a HTTP/1.1 Jun 27 18:45:15.755201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:45:15.755201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:45:15.755201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:45:15.755201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:45:15.755201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:45:15.755201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:45:15.755201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:45:15.755201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:45:15.755201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufqvIxLZ4fgocj_CPRKfD9yCAvi0TNQMRujEfhKccSwIKJ4JVRbZAPSlI3vexLWamSEFIRAbnCKVB4yvO5uv-IcMGJwxsIpMkrMgh2-hAAtHRv1cnWBlbRlIHr-alSdO6SlHxRl4XvpUFmhRfQ5QwDMXtmAfHeVdylQ-msqSXPjor6I Jun 27 18:45:15.755201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:45:15.755201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:45:15.755201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:45:15.755201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:45:15.755201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:45:15.755201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:45:15.755201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: be721490bd6c4084a7d13c39a92e0c05 Jun 27 18:45:15.755201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1691193192 Jun 27 18:45:15.755201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:45:15.755201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:45:15.756319 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/be721490bd6c4084a7d13c39a92e0c05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/be721490bd6c4084a7d13c39a92e0c05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_be721490bd6c4084a7d13c39a92e0c05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/be721490bd6c4084a7d13c39a92e0c05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:45:15.756319 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1691193192 Jun 27 18:45:15.756319 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: be721490bd6c4084a7d13c39a92e0c05 Jun 27 18:45:15.756319 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1691193192 Jun 27 18:45:15.756319 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-VolumesSnapshotsTestJSON-1691193192-project Jun 27 18:45:15.756319 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:45:15.756319 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:45:15.756319 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: e9ce0fe01f5b46b29b9c5a28ca31ac70 Jun 27 18:45:15.756319 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1691193192-project Jun 27 18:45:15.756319 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: Jun 27 18:45:15.756319 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Volume 46133297-b5a1-42c9-9cbf-332e956d0b6a could not be found. Jun 27 18:45:15.756319 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': '46133297-b5a1-42c9-9cbf-332e956d0b6a'} Jun 27 18:45:15.756319 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:45:15.756939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:15.756939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 18:45:15.756939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 18:45:15.756939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 18:45:15.756939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 18:45:15.756939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 18:45:15.756939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 18:45:15.756939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 18:45:15.756939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 18:45:15.756939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 18:45:15.756939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 18:45:15.756939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 18:45:15.756939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 18:45:15.756939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 18:45:15.756939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 18:45:15.756939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 46133297-b5a1-42c9-9cbf-332e956d0b6a could not be found. (HTTP 404) (Request-ID: req-e973e76a-3a26-4db3-8b65-f1648178630c) Jun 27 18:45:15.756939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:15.756939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:15.756939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:15.757923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:15.757923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 18:45:15.757923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 18:45:15.757923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 18:45:15.757923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 18:45:15.757923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 18:45:15.757923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 18:45:15.757923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 18:45:15.757923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 18:45:15.757923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 18:45:15.757923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 18:45:15.757923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 18:45:15.757923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 18:45:15.757923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 18:45:15.757923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 18:45:15.757923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 18:45:15.757923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 18:45:15.757923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 18:45:15.757923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 18:45:15.759499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 18:45:15.759499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 18:45:15.759499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 18:45:15.759499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 18:45:15.759499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 46133297-b5a1-42c9-9cbf-332e956d0b6a could not be found. Jun 27 18:45:15.759499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:15.759499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:15.759499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:15.759499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:15.759499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:45:15.759499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:45:15.759499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:45:15.759499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:45:15.759499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 18:45:15.759499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 18:45:15.759499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:45:15.759499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:45:15.759499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 18:45:15.759499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:45:15.760346 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 46133297-b5a1-42c9-9cbf-332e956d0b6a could not be found. Jun 27 18:45:15.760346 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:15.760346 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:45:15.760346 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:15.760346 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:45:15.760346 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:45:15.760346 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:45:15.760346 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:45:15.760346 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:45:15.760346 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 46133297-b5a1-42c9-9cbf-332e956d0b6a could not be found. Jun 27 18:45:15.760346 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:45:15.762838 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-2d174aee-9a1f-460f-be74-206efbf90e0d tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] Returning 404 to user: Volume 46133297-b5a1-42c9-9cbf-332e956d0b6a could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:45:15.764021 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-2d174aee-9a1f-460f-be74-206efbf90e0d tempest-VolumesSnapshotsTestJSON-1691193192 tempest-VolumesSnapshotsTestJSON-1691193192-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/46133297-b5a1-42c9-9cbf-332e956d0b6a" status: 404 len: 109 microversion: 2.1 time: 0.056780 Jun 27 18:45:15.765133 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 21/34] 10.222.0.15 () {58 vars in 1244 bytes} [Mon Jun 27 18:45:15 2022] GET /compute/v2.1/os-volumes/46133297-b5a1-42c9-9cbf-332e956d0b6a => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:45:20.222975 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-7227798a-e794-46cc-88bd-fe94b7ee90bf tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1498634585", "imageRef": "c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3", "flavorRef": "452", "networks": [{"uuid": "f4d8e32e-8b98-4f28-9802-f05b6f215151"}]}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:45:20.427608 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-e1faa031-741c-4728-b589-e9c819538bae tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Action: 'create', calling method: .version_select at 0x7f701dddb700>, body: {"keypair": {"name": "tempest-keypair-1517937183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKR9oMEUFtJBHp+wkJfsNRg3Og+SdA86wIsCOz9CJJWIg3QQO81xtQfEgwoWqeSNfZgnJAc3Ggk95Hqq+OMeH+N2bO8SlinjNAnHYcFOxbmPL1vIspz1JLkIZFH0Cdmbew=="}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:45:20.443498 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.network.neutron [None req-7227798a-e794-46cc-88bd-fe94b7ee90bf tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] validate_networks() for [('f4d8e32e-8b98-4f28-9802-f05b6f215151', None, None, None, None, None)] {{(pid=124717) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 18:45:20.567043 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-e1faa031-741c-4728-b589-e9c819538bae tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Getting quotas for project 80ec901270bc4375b22fba22ed2ff68c. Resources: {'key_pairs'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:45:20.582045 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-e1faa031-741c-4728-b589-e9c819538bae tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Getting quotas for user f6d74ace9f674f0da40cb35f39d559c9 and project 80ec901270bc4375b22fba22ed2ff68c. Resources: {'key_pairs'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:45:20.776020 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-e1faa031-741c-4728-b589-e9c819538bae tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.968647 Jun 27 18:45:20.779135 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 22/35] 10.222.0.15 () {62 vars in 1199 bytes} [Mon Jun 27 18:45:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 972 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 27 18:45:22.528884 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-defa7a27-3459-4928-8b8e-ee8cb62b8a17 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-130175351", "imageRef": "c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "74ef6afb-6d6c-4546-b97e-477599f56632"}], "security_groups": [{"name": "tempest-securitygroup--314720173"}], "key_name": "tempest-keypair-1722412099", "user_data": "}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:45:22.535327 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-7227798a-e794-46cc-88bd-fe94b7ee90bf tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Flavor limits 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 18:45:22.535807 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-7227798a-e794-46cc-88bd-fe94b7ee90bf tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Image limits 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 18:45:22.536227 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-7227798a-e794-46cc-88bd-fe94b7ee90bf tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Flavor pref 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 18:45:22.536643 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-7227798a-e794-46cc-88bd-fe94b7ee90bf tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Image pref 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 18:45:22.537066 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-7227798a-e794-46cc-88bd-fe94b7ee90bf tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 18:45:22.553239 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7227798a-e794-46cc-88bd-fe94b7ee90bf tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:22.553694 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7227798a-e794-46cc-88bd-fe94b7ee90bf tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:22.554519 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7227798a-e794-46cc-88bd-fe94b7ee90bf tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:22.555153 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7227798a-e794-46cc-88bd-fe94b7ee90bf tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:22.594925 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-7227798a-e794-46cc-88bd-fe94b7ee90bf tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Getting quotas for project f3a70eb47fed4e959fc51400ddc3caf1. Resources: {'ram', 'cores', 'instances'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:45:22.599047 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-7227798a-e794-46cc-88bd-fe94b7ee90bf tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Getting quotas for user daef56aadd1c4edfa6eeadea63050d37 and project f3a70eb47fed4e959fc51400ddc3caf1. Resources: {'ram', 'cores', 'instances'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:45:22.616293 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-7227798a-e794-46cc-88bd-fe94b7ee90bf tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Going to run 1 instances... {{(pid=124717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 18:45:22.619927 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-7227798a-e794-46cc-88bd-fe94b7ee90bf tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 18:45:22.832344 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.network.neutron [None req-defa7a27-3459-4928-8b8e-ee8cb62b8a17 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] validate_networks() for [('74ef6afb-6d6c-4546-b97e-477599f56632', None, None, None, None, None)] {{(pid=124716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 18:45:22.869970 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-7227798a-e794-46cc-88bd-fe94b7ee90bf tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.522499 Jun 27 18:45:22.874849 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 14/36] 10.222.0.15 () {60 vars in 1146 bytes} [Mon Jun 27 18:45:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 3529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 18:45:22.913991 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-46b3b157-ece5-4b33-b0b4-c2366872918e tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:22.919539 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-46b3b157-ece5-4b33-b0b4-c2366872918e tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:23.254877 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-46b3b157-ece5-4b33-b0b4-c2366872918e tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:23.269058 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-46b3b157-ece5-4b33-b0b4-c2366872918e tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1215 microversion: 2.1 time: 0.386645 Jun 27 18:45:23.282435 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 15/37] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:22 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1215 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:24.287409 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0622a806-e1bc-46fd-bbf3-855a0c3dcd8c tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:24.288044 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-0622a806-e1bc-46fd-bbf3-855a0c3dcd8c tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:24.395125 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-0622a806-e1bc-46fd-bbf3-855a0c3dcd8c tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:24.403694 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-0622a806-e1bc-46fd-bbf3-855a0c3dcd8c tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1215 microversion: 2.1 time: 0.119925 Jun 27 18:45:24.404820 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 16/38] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:24 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1215 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:45:24.436092 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-defa7a27-3459-4928-8b8e-ee8cb62b8a17 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Flavor limits 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 18:45:24.437147 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-defa7a27-3459-4928-8b8e-ee8cb62b8a17 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Image limits 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 18:45:24.438027 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-defa7a27-3459-4928-8b8e-ee8cb62b8a17 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Flavor pref 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 18:45:24.438600 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-defa7a27-3459-4928-8b8e-ee8cb62b8a17 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Image pref 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 18:45:24.439126 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-defa7a27-3459-4928-8b8e-ee8cb62b8a17 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 18:45:24.453536 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-defa7a27-3459-4928-8b8e-ee8cb62b8a17 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:24.454139 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-defa7a27-3459-4928-8b8e-ee8cb62b8a17 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:24.455219 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-defa7a27-3459-4928-8b8e-ee8cb62b8a17 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:24.455895 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-defa7a27-3459-4928-8b8e-ee8cb62b8a17 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:24.484073 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-defa7a27-3459-4928-8b8e-ee8cb62b8a17 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Getting quotas for project 0f19df10a9c948ce9c2e0dfa29532e5a. Resources: {'ram', 'cores', 'instances'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:45:24.489196 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-defa7a27-3459-4928-8b8e-ee8cb62b8a17 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Getting quotas for user 2fc6711e48be4d4ab33695e06c7227ab and project 0f19df10a9c948ce9c2e0dfa29532e5a. Resources: {'ram', 'cores', 'instances'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:45:24.521010 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-defa7a27-3459-4928-8b8e-ee8cb62b8a17 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Going to run 1 instances... {{(pid=124716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 18:45:24.522953 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-defa7a27-3459-4928-8b8e-ee8cb62b8a17 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 18:45:24.790932 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-defa7a27-3459-4928-8b8e-ee8cb62b8a17 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.267184 Jun 27 18:45:24.791795 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 23/39] 10.222.0.15 () {60 vars in 1146 bytes} [Mon Jun 27 18:45:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 2270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 18:45:24.803150 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-89aabbb8-95e4-4916-8bf2-2ed9b717caa5 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:24.804046 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-89aabbb8-95e4-4916-8bf2-2ed9b717caa5 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:24.919793 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-89aabbb8-95e4-4916-8bf2-2ed9b717caa5 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:24.930863 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-89aabbb8-95e4-4916-8bf2-2ed9b717caa5 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1237 microversion: 2.1 time: 0.131049 Jun 27 18:45:24.931848 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 17/40] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:24 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1237 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:25.426017 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-006ac700-f84e-48dd-87b2-3dbc700d7ab8 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:25.427840 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-006ac700-f84e-48dd-87b2-3dbc700d7ab8 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:25.525884 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-006ac700-f84e-48dd-87b2-3dbc700d7ab8 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:25.553508 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-006ac700-f84e-48dd-87b2-3dbc700d7ab8 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1215 microversion: 2.1 time: 0.131332 Jun 27 18:45:25.577401 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 24/41] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:25 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:25.952221 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-eb90488f-05a8-4b0f-8495-e6d3ec4c37b1 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:25.952221 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-eb90488f-05a8-4b0f-8495-e6d3ec4c37b1 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:26.034591 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-eb90488f-05a8-4b0f-8495-e6d3ec4c37b1 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:26.044873 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-eb90488f-05a8-4b0f-8495-e6d3ec4c37b1 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1237 microversion: 2.1 time: 0.099971 Jun 27 18:45:26.045673 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 18/42] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:25 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1237 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:26.161656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f88d1e0e-50dd-4fa7-b4eb-5a45be179d38 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-244100368", "imageRef": "c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9615186-335c-44fc-8fc0-824989497b78"}], "security_groups": [{"name": "tempest-securitygroup--1689107954"}], "key_name": "tempest-keypair-1517937183", "user_data": "}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:45:26.403363 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.network.neutron [None req-f88d1e0e-50dd-4fa7-b4eb-5a45be179d38 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] validate_networks() for [('c9615186-335c-44fc-8fc0-824989497b78', None, None, None, None, None)] {{(pid=124716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 18:45:26.574239 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e4aaeab9-4ff7-4835-8946-7cae892f5fa0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:26.577731 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e4aaeab9-4ff7-4835-8946-7cae892f5fa0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:26.592998 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e4aaeab9-4ff7-4835-8946-7cae892f5fa0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:26.595575 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e4aaeab9-4ff7-4835-8946-7cae892f5fa0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:26.601767 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e4aaeab9-4ff7-4835-8946-7cae892f5fa0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:26.603264 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e4aaeab9-4ff7-4835-8946-7cae892f5fa0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:26.820313 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-e4aaeab9-4ff7-4835-8946-7cae892f5fa0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:26.833093 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e4aaeab9-4ff7-4835-8946-7cae892f5fa0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1219 microversion: 2.1 time: 0.263466 Jun 27 18:45:26.842876 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 19/43] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:26 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1219 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:26.962067 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-f88d1e0e-50dd-4fa7-b4eb-5a45be179d38 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Flavor limits 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 18:45:26.962067 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-f88d1e0e-50dd-4fa7-b4eb-5a45be179d38 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Image limits 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 18:45:26.964235 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-f88d1e0e-50dd-4fa7-b4eb-5a45be179d38 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Flavor pref 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 18:45:26.964651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-f88d1e0e-50dd-4fa7-b4eb-5a45be179d38 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Image pref 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 18:45:26.965077 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-f88d1e0e-50dd-4fa7-b4eb-5a45be179d38 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 18:45:26.982292 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f88d1e0e-50dd-4fa7-b4eb-5a45be179d38 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:26.983310 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f88d1e0e-50dd-4fa7-b4eb-5a45be179d38 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:26.984139 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f88d1e0e-50dd-4fa7-b4eb-5a45be179d38 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:26.984578 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f88d1e0e-50dd-4fa7-b4eb-5a45be179d38 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:27.003413 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-f88d1e0e-50dd-4fa7-b4eb-5a45be179d38 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Getting quotas for project 80ec901270bc4375b22fba22ed2ff68c. Resources: {'ram', 'cores', 'instances'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:45:27.007344 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-f88d1e0e-50dd-4fa7-b4eb-5a45be179d38 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Getting quotas for user f6d74ace9f674f0da40cb35f39d559c9 and project 80ec901270bc4375b22fba22ed2ff68c. Resources: {'ram', 'cores', 'instances'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:45:27.025013 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f88d1e0e-50dd-4fa7-b4eb-5a45be179d38 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Going to run 1 instances... {{(pid=124716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 18:45:27.031577 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f88d1e0e-50dd-4fa7-b4eb-5a45be179d38 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 18:45:27.066299 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-b7db44e3-1e22-4d75-9bb7-54cce6f4f16a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:27.066299 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-b7db44e3-1e22-4d75-9bb7-54cce6f4f16a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:27.071564 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b7db44e3-1e22-4d75-9bb7-54cce6f4f16a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:27.071564 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b7db44e3-1e22-4d75-9bb7-54cce6f4f16a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:27.072689 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b7db44e3-1e22-4d75-9bb7-54cce6f4f16a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:27.072901 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b7db44e3-1e22-4d75-9bb7-54cce6f4f16a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:27.156293 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-b7db44e3-1e22-4d75-9bb7-54cce6f4f16a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:27.169335 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-b7db44e3-1e22-4d75-9bb7-54cce6f4f16a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1241 microversion: 2.1 time: 0.110996 Jun 27 18:45:27.170489 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 20/44] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:27 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:45:27.207576 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f88d1e0e-50dd-4fa7-b4eb-5a45be179d38 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.050502 Jun 27 18:45:27.209783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 25/45] 10.222.0.15 () {62 vars in 1187 bytes} [Mon Jun 27 18:45:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 27 18:45:27.221123 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-afb0d151-ae5a-4e69-be3f-b5eca94f0322 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:27.221751 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-afb0d151-ae5a-4e69-be3f-b5eca94f0322 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:27.315986 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-afb0d151-ae5a-4e69-be3f-b5eca94f0322 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:27.330231 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-afb0d151-ae5a-4e69-be3f-b5eca94f0322 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:27.344323 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-afb0d151-ae5a-4e69-be3f-b5eca94f0322 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:27.349226 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-afb0d151-ae5a-4e69-be3f-b5eca94f0322 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1281 microversion: 2.20 time: 0.132444 Jun 27 18:45:27.360473 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 21/46] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:27 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1281 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:45:27.411915 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-e0d7910a-a9f1-4332-92ab-1abe9d11104f tempest-VolumesTestJSON-304550219 tempest-VolumesTestJSON-304550219-project] Calling method '.version_select at 0x7f701c3eb040>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:27.482985 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-e0d7910a-a9f1-4332-92ab-1abe9d11104f tempest-VolumesTestJSON-304550219 tempest-VolumesTestJSON-304550219-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/fccb42d7-3424-4f10-a8ae-ac78c2222b34" status: 200 len: 351 microversion: 2.1 time: 0.084002 Jun 27 18:45:27.483853 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 26/47] 10.222.0.15 () {58 vars in 1244 bytes} [Mon Jun 27 18:45:27 2022] GET /compute/v2.1/os-volumes/fccb42d7-3424-4f10-a8ae-ac78c2222b34 => generated 351 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:45:27.859068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-be46ec9d-c6fa-41e5-bbfe-89e1bc8765cc tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:27.860738 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-be46ec9d-c6fa-41e5-bbfe-89e1bc8765cc tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:27.875670 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-be46ec9d-c6fa-41e5-bbfe-89e1bc8765cc tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:27.876384 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-be46ec9d-c6fa-41e5-bbfe-89e1bc8765cc tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:27.877321 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-be46ec9d-c6fa-41e5-bbfe-89e1bc8765cc tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:27.877912 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-be46ec9d-c6fa-41e5-bbfe-89e1bc8765cc tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:27.987371 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-be46ec9d-c6fa-41e5-bbfe-89e1bc8765cc tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:28.014958 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-be46ec9d-c6fa-41e5-bbfe-89e1bc8765cc tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1267 microversion: 2.1 time: 0.158786 Jun 27 18:45:28.014958 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 22/48] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:27 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:28.186045 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-183da785-a763-4b7c-9806-045d4061a347 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:28.186697 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-183da785-a763-4b7c-9806-045d4061a347 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:28.192947 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-183da785-a763-4b7c-9806-045d4061a347 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:28.193399 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-183da785-a763-4b7c-9806-045d4061a347 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:28.194159 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-183da785-a763-4b7c-9806-045d4061a347 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:28.194630 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-183da785-a763-4b7c-9806-045d4061a347 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:28.349088 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-183da785-a763-4b7c-9806-045d4061a347 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:28.366777 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-183da785-a763-4b7c-9806-045d4061a347 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1289 microversion: 2.1 time: 0.182935 Jun 27 18:45:28.367850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 27/49] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:28 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1289 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:45:28.381420 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-daa03821-948f-4aed-a5fd-acb6df8b5aa9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:28.382040 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-daa03821-948f-4aed-a5fd-acb6df8b5aa9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:28.501653 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-daa03821-948f-4aed-a5fd-acb6df8b5aa9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:28.506047 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-daa03821-948f-4aed-a5fd-acb6df8b5aa9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:28.509766 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-daa03821-948f-4aed-a5fd-acb6df8b5aa9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:28.510977 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-daa03821-948f-4aed-a5fd-acb6df8b5aa9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1281 microversion: 2.20 time: 0.143141 Jun 27 18:45:28.515289 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 23/50] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:28 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1281 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:45:29.030513 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-dc8f3531-56c7-4e58-a880-6297ed3d3301 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:29.031208 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-dc8f3531-56c7-4e58-a880-6297ed3d3301 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:29.038123 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-dc8f3531-56c7-4e58-a880-6297ed3d3301 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:29.040030 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-dc8f3531-56c7-4e58-a880-6297ed3d3301 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:29.040850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-dc8f3531-56c7-4e58-a880-6297ed3d3301 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:29.041859 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-dc8f3531-56c7-4e58-a880-6297ed3d3301 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:29.122993 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-dc8f3531-56c7-4e58-a880-6297ed3d3301 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:29.134497 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-dc8f3531-56c7-4e58-a880-6297ed3d3301 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1273 microversion: 2.1 time: 0.104497 Jun 27 18:45:29.134497 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 28/51] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:29 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:29.388083 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-4a57bb47-59c1-47f4-87e2-34a93368446c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:29.388839 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-4a57bb47-59c1-47f4-87e2-34a93368446c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:29.395471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4a57bb47-59c1-47f4-87e2-34a93368446c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:29.396179 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4a57bb47-59c1-47f4-87e2-34a93368446c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:29.397000 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4a57bb47-59c1-47f4-87e2-34a93368446c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:29.406558 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4a57bb47-59c1-47f4-87e2-34a93368446c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:29.497827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-4a57bb47-59c1-47f4-87e2-34a93368446c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:29.506208 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-4a57bb47-59c1-47f4-87e2-34a93368446c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1295 microversion: 2.1 time: 0.123339 Jun 27 18:45:29.507024 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 24/52] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:29 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1295 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:29.533960 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-578adc91-4de7-41b8-93e3-a5793c374bd2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:29.534657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-578adc91-4de7-41b8-93e3-a5793c374bd2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:29.545657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-578adc91-4de7-41b8-93e3-a5793c374bd2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:29.546337 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-578adc91-4de7-41b8-93e3-a5793c374bd2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:29.550306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-578adc91-4de7-41b8-93e3-a5793c374bd2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:29.550306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-578adc91-4de7-41b8-93e3-a5793c374bd2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:29.622164 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-578adc91-4de7-41b8-93e3-a5793c374bd2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:29.635514 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-578adc91-4de7-41b8-93e3-a5793c374bd2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:29.637045 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-578adc91-4de7-41b8-93e3-a5793c374bd2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:29.638177 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-578adc91-4de7-41b8-93e3-a5793c374bd2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1333 microversion: 2.20 time: 0.108274 Jun 27 18:45:29.638932 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 29/53] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:29 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1333 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:45:29.796218 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-18fb0ada-b7d6-4d5c-ade2-ac37ebeee673 tempest-VolumesTestJSON-304550219 tempest-VolumesTestJSON-304550219-project] Calling method '.version_select at 0x7f701c36a940>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:30.124339 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-18fb0ada-b7d6-4d5c-ade2-ac37ebeee673 tempest-VolumesTestJSON-304550219 tempest-VolumesTestJSON-304550219-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/747d7bb6-68ec-46d9-98de-64bc7a95ae27" status: 200 len: 350 microversion: 2.1 time: 0.332232 Jun 27 18:45:30.125218 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 25/54] 10.222.0.15 () {58 vars in 1244 bytes} [Mon Jun 27 18:45:29 2022] GET /compute/v2.1/os-volumes/747d7bb6-68ec-46d9-98de-64bc7a95ae27 => generated 350 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:45:30.147860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f5cb87ec-7e57-4eee-b31a-241f6ea53c95 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:30.149090 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f5cb87ec-7e57-4eee-b31a-241f6ea53c95 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:30.155837 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f5cb87ec-7e57-4eee-b31a-241f6ea53c95 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:30.156256 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f5cb87ec-7e57-4eee-b31a-241f6ea53c95 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:30.157089 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f5cb87ec-7e57-4eee-b31a-241f6ea53c95 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:30.157538 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f5cb87ec-7e57-4eee-b31a-241f6ea53c95 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:30.525126 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-6b3448e0-44c9-43e2-ada6-727410cc3d61 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:30.525781 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-6b3448e0-44c9-43e2-ada6-727410cc3d61 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:30.539804 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6b3448e0-44c9-43e2-ada6-727410cc3d61 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:30.540149 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6b3448e0-44c9-43e2-ada6-727410cc3d61 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:30.540937 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6b3448e0-44c9-43e2-ada6-727410cc3d61 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:30.560258 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6b3448e0-44c9-43e2-ada6-727410cc3d61 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:31.160703 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f5cb87ec-7e57-4eee-b31a-241f6ea53c95 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:31.174289 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f5cb87ec-7e57-4eee-b31a-241f6ea53c95 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 1.030397 Jun 27 18:45:31.178182 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 30/55] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:30 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:31.193383 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-c7af3783-edab-41b2-8977-3fb288b651f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:31.193383 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-c7af3783-edab-41b2-8977-3fb288b651f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:31.217830 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c7af3783-edab-41b2-8977-3fb288b651f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:31.218539 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c7af3783-edab-41b2-8977-3fb288b651f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:31.219474 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c7af3783-edab-41b2-8977-3fb288b651f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:31.222046 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c7af3783-edab-41b2-8977-3fb288b651f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:31.361791 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c7af3783-edab-41b2-8977-3fb288b651f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:31.382532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c7af3783-edab-41b2-8977-3fb288b651f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:31.396114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c7af3783-edab-41b2-8977-3fb288b651f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:31.398887 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-c7af3783-edab-41b2-8977-3fb288b651f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1339 microversion: 2.20 time: 0.217897 Jun 27 18:45:31.399466 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 31/56] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:31 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1339 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:45:31.413764 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-6b3448e0-44c9-43e2-ada6-727410cc3d61 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:31.422284 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-6b3448e0-44c9-43e2-ada6-727410cc3d61 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.901995 Jun 27 18:45:31.431149 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 26/57] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:30 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:45:32.193823 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f52a08cf-f0b7-4d44-9e07-c40740bdd055 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:32.195651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f52a08cf-f0b7-4d44-9e07-c40740bdd055 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:32.217054 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f52a08cf-f0b7-4d44-9e07-c40740bdd055 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:32.219547 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f52a08cf-f0b7-4d44-9e07-c40740bdd055 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:32.224011 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f52a08cf-f0b7-4d44-9e07-c40740bdd055 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:32.225903 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f52a08cf-f0b7-4d44-9e07-c40740bdd055 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:32.425884 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-041857e8-9185-4023-a68d-59b0da724057 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:32.426637 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-041857e8-9185-4023-a68d-59b0da724057 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:32.469538 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-041857e8-9185-4023-a68d-59b0da724057 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:32.470029 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-041857e8-9185-4023-a68d-59b0da724057 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:32.474023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-041857e8-9185-4023-a68d-59b0da724057 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:32.477224 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-041857e8-9185-4023-a68d-59b0da724057 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:32.590249 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell0:SELECT=2 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:45:32.716450 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-041857e8-9185-4023-a68d-59b0da724057 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:32.728665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-041857e8-9185-4023-a68d-59b0da724057 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:32.731728 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-041857e8-9185-4023-a68d-59b0da724057 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:32.741119 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-041857e8-9185-4023-a68d-59b0da724057 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1339 microversion: 2.20 time: 0.325899 Jun 27 18:45:32.741714 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 27/58] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:32 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1339 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:45:32.769221 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-3a6f6073-634f-4b26-ad47-39f333746e68 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:32.769829 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-3a6f6073-634f-4b26-ad47-39f333746e68 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:32.794469 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3a6f6073-634f-4b26-ad47-39f333746e68 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:32.794469 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3a6f6073-634f-4b26-ad47-39f333746e68 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:32.794469 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3a6f6073-634f-4b26-ad47-39f333746e68 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:32.794469 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3a6f6073-634f-4b26-ad47-39f333746e68 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:32.995368 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f52a08cf-f0b7-4d44-9e07-c40740bdd055 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:33.011430 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f52a08cf-f0b7-4d44-9e07-c40740bdd055 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.821936 Jun 27 18:45:33.012027 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 32/59] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:32 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:33.127900 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7b48b40b-764b-4118-b3b1-326960ae81f4 tempest-VolumesTestJSON-304550219 tempest-VolumesTestJSON-304550219-project] Calling method '.version_select at 0x7f701c399700>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:33.225580 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-7b48b40b-764b-4118-b3b1-326960ae81f4 tempest-VolumesTestJSON-304550219 tempest-VolumesTestJSON-304550219-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/cd250d26-0789-4aea-a260-f0f210708572" status: 200 len: 350 microversion: 2.1 time: 0.102035 Jun 27 18:45:33.230560 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 33/60] 10.222.0.15 () {58 vars in 1244 bytes} [Mon Jun 27 18:45:33 2022] GET /compute/v2.1/os-volumes/cd250d26-0789-4aea-a260-f0f210708572 => generated 350 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:45:33.299035 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-4bcf53e7-d560-4a82-bd5b-fea69f9dfb99 req-540718ca-75d8-4db9-8cf4-af20b11bf4ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd4240ca-4c5b-441f-b4f3-659defed4c91", "tag": "41a01167-c069-4cd5-8459-b0f4a8178e28"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:45:33.309935 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-3a6f6073-634f-4b26-ad47-39f333746e68 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:33.313622 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-4bcf53e7-d560-4a82-bd5b-fea69f9dfb99 req-540718ca-75d8-4db9-8cf4-af20b11bf4ff service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:33.314072 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-4bcf53e7-d560-4a82-bd5b-fea69f9dfb99 req-540718ca-75d8-4db9-8cf4-af20b11bf4ff service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:33.316796 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-3a6f6073-634f-4b26-ad47-39f333746e68 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.568005 Jun 27 18:45:33.317522 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 28/61] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:32 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:33.322213 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-6d91fa37-7f9e-4491-83d0-38a56cf17ab0 tempest-VolumesTestJSON-304550219 tempest-VolumesTestJSON-304550219-project] Calling method '.version_select at 0x7f701c36a670>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:33.343057 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-4bcf53e7-d560-4a82-bd5b-fea69f9dfb99 req-540718ca-75d8-4db9-8cf4-af20b11bf4ff service nova] Creating event network-changed:41a01167-c069-4cd5-8459-b0f4a8178e28 for instance bd4240ca-4c5b-441f-b4f3-659defed4c91 on hv-cinder-84460 Jun 27 18:45:33.343592 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-4bcf53e7-d560-4a82-bd5b-fea69f9dfb99 req-540718ca-75d8-4db9-8cf4-af20b11bf4ff service nova] Acquired lock "compute-rpcapi-router" {{(pid=124716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 27 18:45:33.344690 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3dc03f1d-653b-42d3-8dfd-3d78f317e933 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:33.345130 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3dc03f1d-653b-42d3-8dfd-3d78f317e933 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:33.345908 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3dc03f1d-653b-42d3-8dfd-3d78f317e933 None None] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:33.346341 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3dc03f1d-653b-42d3-8dfd-3d78f317e933 None None] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:33.355927 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.compute.rpcapi [None req-3dc03f1d-653b-42d3-8dfd-3d78f317e933 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 27 18:45:33.357148 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3dc03f1d-653b-42d3-8dfd-3d78f317e933 None None] Releasing lock "compute-rpcapi-router" {{(pid=124716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 27 18:45:33.375987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-3dc03f1d-653b-42d3-8dfd-3d78f317e933 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143812 Jun 27 18:45:33.380233 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 34/62] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:45:33.408821 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-6d91fa37-7f9e-4491-83d0-38a56cf17ab0 tempest-VolumesTestJSON-304550219 tempest-VolumesTestJSON-304550219-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.089850 Jun 27 18:45:33.409585 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 29/63] 10.222.0.15 () {58 vars in 1133 bytes} [Mon Jun 27 18:45:33 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:33.422801 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-3d7e8b3c-a47f-43b1-8cc9-846aa3cb9362 tempest-VolumesTestJSON-304550219 tempest-VolumesTestJSON-304550219-project] Calling method '.version_select at 0x7f701c32c8b0>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:33.515394 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-3d7e8b3c-a47f-43b1-8cc9-846aa3cb9362 tempest-VolumesTestJSON-304550219 tempest-VolumesTestJSON-304550219-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.096937 Jun 27 18:45:33.520949 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 35/64] 10.222.0.15 () {58 vars in 1148 bytes} [Mon Jun 27 18:45:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:45:33.530689 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0a130794-d2e8-4365-9a66-8fb22cde2104 tempest-VolumesTestJSON-304550219 tempest-VolumesTestJSON-304550219-project] Calling method '.version_select at 0x7f701c36a550>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:33.651870 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-0a130794-d2e8-4365-9a66-8fb22cde2104 tempest-VolumesTestJSON-304550219 tempest-VolumesTestJSON-304550219-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.124641 Jun 27 18:45:33.653628 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 30/65] 10.222.0.15 () {58 vars in 1133 bytes} [Mon Jun 27 18:45:33 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:33.673408 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-cb2ee47e-e9a5-49d3-8ddd-7a3b5567a0af tempest-VolumesTestJSON-304550219 tempest-VolumesTestJSON-304550219-project] Calling method '.version_select at 0x7f701c343550>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:33.705745 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-549c1e4c-7a7b-4e14-9ed4-8a6681bf9c64 req-5f4cbcbd-c720-474c-b015-9894a9e0e772 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d", "tag": "c971b6f4-bf7c-4cee-89cc-b5e2dc176ce5"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:45:33.747862 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-549c1e4c-7a7b-4e14-9ed4-8a6681bf9c64 req-5f4cbcbd-c720-474c-b015-9894a9e0e772 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:33.748295 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-549c1e4c-7a7b-4e14-9ed4-8a6681bf9c64 req-5f4cbcbd-c720-474c-b015-9894a9e0e772 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:33.772073 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-549c1e4c-7a7b-4e14-9ed4-8a6681bf9c64 req-5f4cbcbd-c720-474c-b015-9894a9e0e772 service nova] Creating event network-changed:c971b6f4-bf7c-4cee-89cc-b5e2dc176ce5 for instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d on hv-cinder-84460 Jun 27 18:45:33.774306 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-cb2ee47e-e9a5-49d3-8ddd-7a3b5567a0af tempest-VolumesTestJSON-304550219 tempest-VolumesTestJSON-304550219-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.108778 Jun 27 18:45:33.774935 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 31/66] 10.222.0.15 () {58 vars in 1166 bytes} [Mon Jun 27 18:45:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:45:33.779994 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-7837fb12-1fae-4a7e-9ae0-4dd28d884dca tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:33.780800 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-7837fb12-1fae-4a7e-9ae0-4dd28d884dca tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:33.789855 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7837fb12-1fae-4a7e-9ae0-4dd28d884dca tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:33.789855 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7837fb12-1fae-4a7e-9ae0-4dd28d884dca tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:33.790748 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7837fb12-1fae-4a7e-9ae0-4dd28d884dca tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:33.791206 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7837fb12-1fae-4a7e-9ae0-4dd28d884dca tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:33.791373 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-549c1e4c-7a7b-4e14-9ed4-8a6681bf9c64 req-5f4cbcbd-c720-474c-b015-9894a9e0e772 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.241822 Jun 27 18:45:33.791962 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 36/67] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:45:33.798630 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-15825d56-9049-4ae5-af37-4356099427e5 tempest-VolumesTestJSON-304550219 tempest-VolumesTestJSON-304550219-project] Calling method '.version_select at 0x7f701dd2e280>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:33.904088 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-15825d56-9049-4ae5-af37-4356099427e5 tempest-VolumesTestJSON-304550219 tempest-VolumesTestJSON-304550219-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.110377 Jun 27 18:45:33.905039 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 37/68] 10.222.0.15 () {58 vars in 1169 bytes} [Mon Jun 27 18:45:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:45:33.918525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-62b2109f-16a7-4aae-aca4-fd8b601a9665 tempest-VolumesTestJSON-304550219 tempest-VolumesTestJSON-304550219-project] Calling method '.version_select at 0x7f701c340040>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:33.995684 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-7837fb12-1fae-4a7e-9ae0-4dd28d884dca tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:34.009848 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-62b2109f-16a7-4aae-aca4-fd8b601a9665 tempest-VolumesTestJSON-304550219 tempest-VolumesTestJSON-304550219-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.096548 Jun 27 18:45:34.010557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 38/69] 10.222.0.15 () {58 vars in 1154 bytes} [Mon Jun 27 18:45:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:45:34.021426 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-7837fb12-1fae-4a7e-9ae0-4dd28d884dca tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:34.021426 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-7837fb12-1fae-4a7e-9ae0-4dd28d884dca tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:34.022352 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-d6fa199e-4bfb-4487-8a9a-5f825094b138 tempest-VolumesTestJSON-304550219 tempest-VolumesTestJSON-304550219-project] Calling method '.version_select at 0x7f701c35e430>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:34.022483 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-7837fb12-1fae-4a7e-9ae0-4dd28d884dca tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.246508 Jun 27 18:45:34.026518 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 32/70] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:33 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:45:34.031745 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-f545c063-df3e-4d81-b23b-0727a37efe3a tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:34.034834 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-f545c063-df3e-4d81-b23b-0727a37efe3a tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:34.042360 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f545c063-df3e-4d81-b23b-0727a37efe3a tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:34.042913 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f545c063-df3e-4d81-b23b-0727a37efe3a tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:34.043863 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f545c063-df3e-4d81-b23b-0727a37efe3a tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:34.044388 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f545c063-df3e-4d81-b23b-0727a37efe3a tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:34.113915 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-d6fa199e-4bfb-4487-8a9a-5f825094b138 tempest-VolumesTestJSON-304550219 tempest-VolumesTestJSON-304550219-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.095884 Jun 27 18:45:34.115151 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 39/71] 10.222.0.15 () {58 vars in 1187 bytes} [Mon Jun 27 18:45:34 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:45:34.126730 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-6e24dbca-3311-4e0c-b28a-dafed85935bd tempest-VolumesTestJSON-304550219 tempest-VolumesTestJSON-304550219-project] Calling method '.version_select at 0x7f701c35e040>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:34.194765 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-f545c063-df3e-4d81-b23b-0727a37efe3a tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:34.203839 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-f545c063-df3e-4d81-b23b-0727a37efe3a tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.176191 Jun 27 18:45:34.204443 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 33/72] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:34 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:34.219869 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-6e24dbca-3311-4e0c-b28a-dafed85935bd tempest-VolumesTestJSON-304550219 tempest-VolumesTestJSON-304550219-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.096975 Jun 27 18:45:34.220433 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 40/73] 10.222.0.15 () {58 vars in 1154 bytes} [Mon Jun 27 18:45:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:45:34.333321 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-454ef4f4-e37c-4734-893d-db18d80ffea0 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:34.334097 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-454ef4f4-e37c-4734-893d-db18d80ffea0 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:34.340620 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-454ef4f4-e37c-4734-893d-db18d80ffea0 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:34.341073 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-454ef4f4-e37c-4734-893d-db18d80ffea0 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:34.341825 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-454ef4f4-e37c-4734-893d-db18d80ffea0 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:34.342273 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-454ef4f4-e37c-4734-893d-db18d80ffea0 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:34.605548 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-454ef4f4-e37c-4734-893d-db18d80ffea0 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:34.613172 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-454ef4f4-e37c-4734-893d-db18d80ffea0 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.283727 Jun 27 18:45:34.613769 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 34/74] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:34 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:35.041569 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a6127c93-2470-4675-b08c-f3a0e6d68cfb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:35.042328 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a6127c93-2470-4675-b08c-f3a0e6d68cfb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:35.048601 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a6127c93-2470-4675-b08c-f3a0e6d68cfb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:35.049049 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a6127c93-2470-4675-b08c-f3a0e6d68cfb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:35.049804 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a6127c93-2470-4675-b08c-f3a0e6d68cfb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:35.050268 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a6127c93-2470-4675-b08c-f3a0e6d68cfb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:35.184615 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a6127c93-2470-4675-b08c-f3a0e6d68cfb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:35.192718 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a6127c93-2470-4675-b08c-f3a0e6d68cfb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:35.194267 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a6127c93-2470-4675-b08c-f3a0e6d68cfb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:35.196113 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a6127c93-2470-4675-b08c-f3a0e6d68cfb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.159226 Jun 27 18:45:35.196961 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 41/75] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:35 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:45:35.221032 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-be53980b-64b2-433e-943b-91240b8dea39 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:35.221660 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-be53980b-64b2-433e-943b-91240b8dea39 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:35.228198 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-be53980b-64b2-433e-943b-91240b8dea39 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:35.228664 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-be53980b-64b2-433e-943b-91240b8dea39 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:35.229487 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-be53980b-64b2-433e-943b-91240b8dea39 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:35.229930 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-be53980b-64b2-433e-943b-91240b8dea39 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:35.362035 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-be53980b-64b2-433e-943b-91240b8dea39 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:35.369639 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-be53980b-64b2-433e-943b-91240b8dea39 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.152521 Jun 27 18:45:35.370235 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 35/76] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:35 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:35.629708 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-52a6914d-3108-433c-bf5d-8e1044c89035 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:35.630321 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-52a6914d-3108-433c-bf5d-8e1044c89035 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:35.637190 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-52a6914d-3108-433c-bf5d-8e1044c89035 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:35.637632 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-52a6914d-3108-433c-bf5d-8e1044c89035 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:35.638406 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-52a6914d-3108-433c-bf5d-8e1044c89035 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:35.638842 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-52a6914d-3108-433c-bf5d-8e1044c89035 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:35.782651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-52a6914d-3108-433c-bf5d-8e1044c89035 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:35.790879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-52a6914d-3108-433c-bf5d-8e1044c89035 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.164861 Jun 27 18:45:35.800911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 42/77] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:35 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:36.214893 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-8552cbc2-e086-419b-bb0b-a78d20987ecf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:36.215565 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-8552cbc2-e086-419b-bb0b-a78d20987ecf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:36.221613 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8552cbc2-e086-419b-bb0b-a78d20987ecf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:36.222046 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8552cbc2-e086-419b-bb0b-a78d20987ecf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:36.223041 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8552cbc2-e086-419b-bb0b-a78d20987ecf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:36.223482 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8552cbc2-e086-419b-bb0b-a78d20987ecf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:36.387028 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-8552cbc2-e086-419b-bb0b-a78d20987ecf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:36.388346 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-28998096-d4d3-4a1e-84a9-c89590283ee0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:36.389169 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-28998096-d4d3-4a1e-84a9-c89590283ee0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:36.397778 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-28998096-d4d3-4a1e-84a9-c89590283ee0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:36.399638 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-28998096-d4d3-4a1e-84a9-c89590283ee0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:36.400682 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-28998096-d4d3-4a1e-84a9-c89590283ee0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:36.401325 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-28998096-d4d3-4a1e-84a9-c89590283ee0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:36.402520 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-8552cbc2-e086-419b-bb0b-a78d20987ecf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:36.405403 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-8552cbc2-e086-419b-bb0b-a78d20987ecf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:36.406962 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-8552cbc2-e086-419b-bb0b-a78d20987ecf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.195067 Jun 27 18:45:36.407854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 36/78] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:36 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:45:36.571291 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-28998096-d4d3-4a1e-84a9-c89590283ee0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:36.579782 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-28998096-d4d3-4a1e-84a9-c89590283ee0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.195186 Jun 27 18:45:36.580442 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 43/79] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:36 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:36.808588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0a60a6f9-c9cc-499e-8247-73ddc638dec9 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:36.809597 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-0a60a6f9-c9cc-499e-8247-73ddc638dec9 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:36.816048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0a60a6f9-c9cc-499e-8247-73ddc638dec9 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:36.816629 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0a60a6f9-c9cc-499e-8247-73ddc638dec9 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:36.817615 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0a60a6f9-c9cc-499e-8247-73ddc638dec9 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:36.818118 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0a60a6f9-c9cc-499e-8247-73ddc638dec9 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:37.001047 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-0a60a6f9-c9cc-499e-8247-73ddc638dec9 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:37.009752 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-0a60a6f9-c9cc-499e-8247-73ddc638dec9 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.205727 Jun 27 18:45:37.017432 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 37/80] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:36 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:37.430928 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=18 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:45:37.436613 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a03383bd-5b1e-442d-b4c1-903b6fd2a9de tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:37.437265 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a03383bd-5b1e-442d-b4c1-903b6fd2a9de tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:37.443925 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a03383bd-5b1e-442d-b4c1-903b6fd2a9de tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:37.444369 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a03383bd-5b1e-442d-b4c1-903b6fd2a9de tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:37.445792 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a03383bd-5b1e-442d-b4c1-903b6fd2a9de tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:37.446233 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a03383bd-5b1e-442d-b4c1-903b6fd2a9de tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:37.600754 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-07073e08-00d2-4aa5-bcab-ec2ac3c2cfea tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:37.602959 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-07073e08-00d2-4aa5-bcab-ec2ac3c2cfea tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:37.612018 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-07073e08-00d2-4aa5-bcab-ec2ac3c2cfea tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:37.612688 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-07073e08-00d2-4aa5-bcab-ec2ac3c2cfea tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:37.614272 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-07073e08-00d2-4aa5-bcab-ec2ac3c2cfea tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:37.615170 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-07073e08-00d2-4aa5-bcab-ec2ac3c2cfea tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:37.621803 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a03383bd-5b1e-442d-b4c1-903b6fd2a9de tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:37.630943 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a03383bd-5b1e-442d-b4c1-903b6fd2a9de tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:37.633248 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a03383bd-5b1e-442d-b4c1-903b6fd2a9de tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:37.634668 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a03383bd-5b1e-442d-b4c1-903b6fd2a9de tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.205490 Jun 27 18:45:37.635824 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 44/81] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:37 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:45:37.776530 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-07073e08-00d2-4aa5-bcab-ec2ac3c2cfea tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:37.785385 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-07073e08-00d2-4aa5-bcab-ec2ac3c2cfea tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.191625 Jun 27 18:45:37.785974 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 38/82] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:37 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:38.030374 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-091ffbfe-3a16-4d0d-a279-bf34950d8bce tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:38.031424 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-091ffbfe-3a16-4d0d-a279-bf34950d8bce tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:38.037692 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-091ffbfe-3a16-4d0d-a279-bf34950d8bce tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:38.038153 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-091ffbfe-3a16-4d0d-a279-bf34950d8bce tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:38.040034 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-091ffbfe-3a16-4d0d-a279-bf34950d8bce tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:38.041122 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-091ffbfe-3a16-4d0d-a279-bf34950d8bce tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:38.188752 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-091ffbfe-3a16-4d0d-a279-bf34950d8bce tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:38.196760 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-091ffbfe-3a16-4d0d-a279-bf34950d8bce tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.170615 Jun 27 18:45:38.197351 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 45/83] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:38 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:38.653010 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0d21b301-5232-4b03-a049-2130602a733d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:38.654261 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-0d21b301-5232-4b03-a049-2130602a733d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:38.670191 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell0:SELECT=22 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:45:38.672194 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0d21b301-5232-4b03-a049-2130602a733d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:38.679722 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0d21b301-5232-4b03-a049-2130602a733d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:38.681089 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0d21b301-5232-4b03-a049-2130602a733d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:38.682084 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0d21b301-5232-4b03-a049-2130602a733d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:38.803189 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-0b704dcb-e830-416d-97f7-74dac8ff431e tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:38.803811 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-0b704dcb-e830-416d-97f7-74dac8ff431e tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:38.816428 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0b704dcb-e830-416d-97f7-74dac8ff431e tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:38.816886 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0b704dcb-e830-416d-97f7-74dac8ff431e tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:38.817777 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0b704dcb-e830-416d-97f7-74dac8ff431e tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:38.818224 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0b704dcb-e830-416d-97f7-74dac8ff431e tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:39.058345 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-0d21b301-5232-4b03-a049-2130602a733d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:39.069964 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-0d21b301-5232-4b03-a049-2130602a733d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:39.072545 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-0d21b301-5232-4b03-a049-2130602a733d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:39.074045 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-0d21b301-5232-4b03-a049-2130602a733d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.425107 Jun 27 18:45:39.085486 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 39/84] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:38 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:45:39.132217 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-0b704dcb-e830-416d-97f7-74dac8ff431e tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:39.139847 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-0b704dcb-e830-416d-97f7-74dac8ff431e tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.340882 Jun 27 18:45:39.140442 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 46/85] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:38 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:39.214723 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-f815919c-1b63-4d02-b711-9a196407b93a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:39.217816 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-f815919c-1b63-4d02-b711-9a196407b93a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:39.225002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f815919c-1b63-4d02-b711-9a196407b93a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:39.225772 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f815919c-1b63-4d02-b711-9a196407b93a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:39.226772 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f815919c-1b63-4d02-b711-9a196407b93a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:39.227218 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f815919c-1b63-4d02-b711-9a196407b93a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:39.432473 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-f815919c-1b63-4d02-b711-9a196407b93a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:39.449743 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-f815919c-1b63-4d02-b711-9a196407b93a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.231004 Jun 27 18:45:39.452406 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 40/86] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:39 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:45:40.096152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-fd8a630d-6059-4031-b35b-6766f8667b6e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:40.097431 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-fd8a630d-6059-4031-b35b-6766f8667b6e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:40.108330 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd8a630d-6059-4031-b35b-6766f8667b6e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:40.110958 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd8a630d-6059-4031-b35b-6766f8667b6e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:40.111771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd8a630d-6059-4031-b35b-6766f8667b6e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:40.112916 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd8a630d-6059-4031-b35b-6766f8667b6e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:40.162902 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-59bcd639-3e19-40a4-b917-f4871d7b34af tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:40.164121 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-59bcd639-3e19-40a4-b917-f4871d7b34af tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:40.175629 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-59bcd639-3e19-40a4-b917-f4871d7b34af tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:40.178364 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-59bcd639-3e19-40a4-b917-f4871d7b34af tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:40.179737 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-59bcd639-3e19-40a4-b917-f4871d7b34af tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:40.180575 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-59bcd639-3e19-40a4-b917-f4871d7b34af tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:40.201777 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=100 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:45:40.522173 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-fd8a630d-6059-4031-b35b-6766f8667b6e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:40.534310 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-59bcd639-3e19-40a4-b917-f4871d7b34af tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:40.539343 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-fd8a630d-6059-4031-b35b-6766f8667b6e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:40.543766 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-fd8a630d-6059-4031-b35b-6766f8667b6e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:40.545591 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-59bcd639-3e19-40a4-b917-f4871d7b34af tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.392529 Jun 27 18:45:40.546704 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 41/87] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:40 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:40.554962 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-50f5d36d-6f03-44e1-89b2-65d4ecbd4ec1 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:40.554962 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-50f5d36d-6f03-44e1-89b2-65d4ecbd4ec1 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:40.556635 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-fd8a630d-6059-4031-b35b-6766f8667b6e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.467565 Jun 27 18:45:40.557559 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 47/88] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:40 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:45:40.570347 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-50f5d36d-6f03-44e1-89b2-65d4ecbd4ec1 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:40.571415 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-50f5d36d-6f03-44e1-89b2-65d4ecbd4ec1 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:40.572268 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-50f5d36d-6f03-44e1-89b2-65d4ecbd4ec1 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:40.572770 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-50f5d36d-6f03-44e1-89b2-65d4ecbd4ec1 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:40.780285 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-50f5d36d-6f03-44e1-89b2-65d4ecbd4ec1 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:40.788434 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-50f5d36d-6f03-44e1-89b2-65d4ecbd4ec1 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.240066 Jun 27 18:45:40.790336 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 42/89] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:40 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:41.563648 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-27c45a48-0d30-454e-a1f0-c210ab7a5cba tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:41.564901 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-27c45a48-0d30-454e-a1f0-c210ab7a5cba tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:41.572452 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-27c45a48-0d30-454e-a1f0-c210ab7a5cba tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:41.578265 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e46b2c6f-b4be-45b6-822c-fc882d7d8c6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:41.579608 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e46b2c6f-b4be-45b6-822c-fc882d7d8c6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:41.584593 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-27c45a48-0d30-454e-a1f0-c210ab7a5cba tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:41.587452 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-27c45a48-0d30-454e-a1f0-c210ab7a5cba tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:41.588846 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-27c45a48-0d30-454e-a1f0-c210ab7a5cba tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:41.591961 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e46b2c6f-b4be-45b6-822c-fc882d7d8c6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:41.591961 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e46b2c6f-b4be-45b6-822c-fc882d7d8c6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:41.595718 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e46b2c6f-b4be-45b6-822c-fc882d7d8c6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:41.596171 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e46b2c6f-b4be-45b6-822c-fc882d7d8c6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:41.909418 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-27c45a48-0d30-454e-a1f0-c210ab7a5cba tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:41.914345 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-e46b2c6f-b4be-45b6-822c-fc882d7d8c6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:41.918666 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-27c45a48-0d30-454e-a1f0-c210ab7a5cba tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.359233 Jun 27 18:45:41.919876 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 48/90] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:41 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:41.924817 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-3f30d29f-0183-4f69-9c55-ba248e42e99f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:41.925370 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-e46b2c6f-b4be-45b6-822c-fc882d7d8c6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:41.926191 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-3f30d29f-0183-4f69-9c55-ba248e42e99f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:41.929503 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-e46b2c6f-b4be-45b6-822c-fc882d7d8c6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:41.930688 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e46b2c6f-b4be-45b6-822c-fc882d7d8c6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.356476 Jun 27 18:45:41.932939 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 43/91] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:41 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:45:41.942979 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3f30d29f-0183-4f69-9c55-ba248e42e99f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:41.943562 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3f30d29f-0183-4f69-9c55-ba248e42e99f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:41.945255 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3f30d29f-0183-4f69-9c55-ba248e42e99f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:41.945799 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3f30d29f-0183-4f69-9c55-ba248e42e99f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:42.108807 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3f30d29f-0183-4f69-9c55-ba248e42e99f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:42.113014 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=100 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:45:42.117955 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-3f30d29f-0183-4f69-9c55-ba248e42e99f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.196789 Jun 27 18:45:42.118564 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 49/92] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:41 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:42.938210 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-911d3279-2e66-4866-895b-84a04fafd68d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:42.938876 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-911d3279-2e66-4866-895b-84a04fafd68d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:42.948112 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-911d3279-2e66-4866-895b-84a04fafd68d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:42.948641 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-911d3279-2e66-4866-895b-84a04fafd68d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:42.953339 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-911d3279-2e66-4866-895b-84a04fafd68d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:42.953339 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-911d3279-2e66-4866-895b-84a04fafd68d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:42.953662 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-1de4ac61-0810-4994-ae35-0f0d4c3de870 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:42.953662 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-1de4ac61-0810-4994-ae35-0f0d4c3de870 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:42.962008 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:45:42.963641 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1de4ac61-0810-4994-ae35-0f0d4c3de870 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:42.967009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1de4ac61-0810-4994-ae35-0f0d4c3de870 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:42.968042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1de4ac61-0810-4994-ae35-0f0d4c3de870 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:42.968670 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1de4ac61-0810-4994-ae35-0f0d4c3de870 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:43.267315 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-1de4ac61-0810-4994-ae35-0f0d4c3de870 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:43.272312 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-911d3279-2e66-4866-895b-84a04fafd68d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:43.279751 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-1de4ac61-0810-4994-ae35-0f0d4c3de870 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:43.282002 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-1de4ac61-0810-4994-ae35-0f0d4c3de870 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:43.283532 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-911d3279-2e66-4866-895b-84a04fafd68d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.348635 Jun 27 18:45:43.283801 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-1de4ac61-0810-4994-ae35-0f0d4c3de870 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.338063 Jun 27 18:45:43.284491 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 50/93] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:42 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:45:43.289936 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-0ac7e17d-d40e-41c5-aa66-0ec361da7262 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:43.293599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 44/94] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:42 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:43.295339 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-0ac7e17d-d40e-41c5-aa66-0ec361da7262 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:43.301050 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0ac7e17d-d40e-41c5-aa66-0ec361da7262 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:43.301736 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0ac7e17d-d40e-41c5-aa66-0ec361da7262 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:43.302730 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0ac7e17d-d40e-41c5-aa66-0ec361da7262 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:43.303327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0ac7e17d-d40e-41c5-aa66-0ec361da7262 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:43.355815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=6 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:45:43.468842 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-0ac7e17d-d40e-41c5-aa66-0ec361da7262 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:43.478571 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-0ac7e17d-d40e-41c5-aa66-0ec361da7262 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.192625 Jun 27 18:45:43.479513 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 51/95] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:43 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:44.301054 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-33b07139-63c5-41a7-a41c-c47a99dcfdf0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:44.302036 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-33b07139-63c5-41a7-a41c-c47a99dcfdf0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:44.309926 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-b8c246a4-41a0-4533-aeca-e97a0a0e3080 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:44.310498 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:45:44.310750 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-b8c246a4-41a0-4533-aeca-e97a0a0e3080 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:44.311591 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-33b07139-63c5-41a7-a41c-c47a99dcfdf0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:44.316206 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-33b07139-63c5-41a7-a41c-c47a99dcfdf0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:44.317656 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-33b07139-63c5-41a7-a41c-c47a99dcfdf0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:44.318780 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-33b07139-63c5-41a7-a41c-c47a99dcfdf0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:44.327278 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b8c246a4-41a0-4533-aeca-e97a0a0e3080 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:44.330070 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b8c246a4-41a0-4533-aeca-e97a0a0e3080 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:44.334924 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b8c246a4-41a0-4533-aeca-e97a0a0e3080 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:44.335478 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b8c246a4-41a0-4533-aeca-e97a0a0e3080 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:45.124502 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-b8c246a4-41a0-4533-aeca-e97a0a0e3080 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:45.133702 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-b8c246a4-41a0-4533-aeca-e97a0a0e3080 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:45.135269 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-b8c246a4-41a0-4533-aeca-e97a0a0e3080 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:45.136434 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-b8c246a4-41a0-4533-aeca-e97a0a0e3080 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.831023 Jun 27 18:45:45.143676 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-33b07139-63c5-41a7-a41c-c47a99dcfdf0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:45.159430 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-33b07139-63c5-41a7-a41c-c47a99dcfdf0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.862080 Jun 27 18:45:45.169421 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 52/96] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:44 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:45:45.170906 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 45/97] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:44 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:45.175013 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7fc797cf-bc79-484d-a3ba-5fce256b48a8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:45.180221 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-7fc797cf-bc79-484d-a3ba-5fce256b48a8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:45.219983 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7fc797cf-bc79-484d-a3ba-5fce256b48a8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:45.220748 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7fc797cf-bc79-484d-a3ba-5fce256b48a8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:45.226426 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7fc797cf-bc79-484d-a3ba-5fce256b48a8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:45.228213 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7fc797cf-bc79-484d-a3ba-5fce256b48a8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:45.491279 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-7fc797cf-bc79-484d-a3ba-5fce256b48a8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:45.500398 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-7fc797cf-bc79-484d-a3ba-5fce256b48a8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.329851 Jun 27 18:45:45.502488 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 53/98] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:45 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:45.711440 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-8b33e9e7-815d-4111-abee-92bd8b372c77 req-7b478851-e505-4ef6-a5e1-db791f7d6edd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91366512-6fa4-4a20-a867-94852749b02f", "tag": "3ca020b2-805d-45e4-9147-1a3d32b54834"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:45:45.723124 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-8b33e9e7-815d-4111-abee-92bd8b372c77 req-7b478851-e505-4ef6-a5e1-db791f7d6edd service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:45.723787 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-8b33e9e7-815d-4111-abee-92bd8b372c77 req-7b478851-e505-4ef6-a5e1-db791f7d6edd service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:45.755660 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-8b33e9e7-815d-4111-abee-92bd8b372c77 req-7b478851-e505-4ef6-a5e1-db791f7d6edd service nova] Creating event network-changed:3ca020b2-805d-45e4-9147-1a3d32b54834 for instance 91366512-6fa4-4a20-a867-94852749b02f on hv-cinder-84460 Jun 27 18:45:45.756189 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-8b33e9e7-815d-4111-abee-92bd8b372c77 req-7b478851-e505-4ef6-a5e1-db791f7d6edd service nova] Acquired lock "compute-rpcapi-router" {{(pid=124717) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 27 18:45:45.757948 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e6441c12-ae88-4c92-8ba0-d0a84630efe6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:45.758409 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e6441c12-ae88-4c92-8ba0-d0a84630efe6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:45.759198 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e6441c12-ae88-4c92-8ba0-d0a84630efe6 None None] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:45.765755 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e6441c12-ae88-4c92-8ba0-d0a84630efe6 None None] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:45.768953 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.compute.rpcapi [None req-e6441c12-ae88-4c92-8ba0-d0a84630efe6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 27 18:45:45.769841 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e6441c12-ae88-4c92-8ba0-d0a84630efe6 None None] Releasing lock "compute-rpcapi-router" {{(pid=124717) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 27 18:45:45.790258 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e6441c12-ae88-4c92-8ba0-d0a84630efe6 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083406 Jun 27 18:45:45.791355 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 46/99] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:45:46.154666 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-3da9d946-8943-4231-8d9b-93dde5d324ae tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:46.158312 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-3da9d946-8943-4231-8d9b-93dde5d324ae tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:46.165755 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3da9d946-8943-4231-8d9b-93dde5d324ae tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:46.166206 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3da9d946-8943-4231-8d9b-93dde5d324ae tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:46.167140 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3da9d946-8943-4231-8d9b-93dde5d324ae tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:46.167828 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3da9d946-8943-4231-8d9b-93dde5d324ae tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:46.177675 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-b1d9adc6-9fd3-4879-b41f-beee50595aee tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:46.180529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-b1d9adc6-9fd3-4879-b41f-beee50595aee tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:46.188723 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b1d9adc6-9fd3-4879-b41f-beee50595aee tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:46.189239 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b1d9adc6-9fd3-4879-b41f-beee50595aee tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:46.190219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b1d9adc6-9fd3-4879-b41f-beee50595aee tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:46.190766 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b1d9adc6-9fd3-4879-b41f-beee50595aee tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:46.371498 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3da9d946-8943-4231-8d9b-93dde5d324ae tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:46.383444 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3da9d946-8943-4231-8d9b-93dde5d324ae tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:46.388272 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3da9d946-8943-4231-8d9b-93dde5d324ae tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:46.388272 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-3da9d946-8943-4231-8d9b-93dde5d324ae tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.235464 Jun 27 18:45:46.388272 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 54/100] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:46 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:45:46.396638 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-b1d9adc6-9fd3-4879-b41f-beee50595aee tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:46.404503 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-b1d9adc6-9fd3-4879-b41f-beee50595aee tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.231640 Jun 27 18:45:46.405089 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 47/101] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:46 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:45:46.517220 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-e606ce75-1c17-4e93-b819-9040925c3dc4 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:46.517772 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-e606ce75-1c17-4e93-b819-9040925c3dc4 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:46.524295 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e606ce75-1c17-4e93-b819-9040925c3dc4 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:46.530085 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e606ce75-1c17-4e93-b819-9040925c3dc4 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:46.530085 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e606ce75-1c17-4e93-b819-9040925c3dc4 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:46.530085 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e606ce75-1c17-4e93-b819-9040925c3dc4 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:46.656025 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-e606ce75-1c17-4e93-b819-9040925c3dc4 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:46.663988 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-e606ce75-1c17-4e93-b819-9040925c3dc4 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.150084 Jun 27 18:45:46.664768 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 55/102] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:46 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:47.404985 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-f6f0ebe2-ecad-4d7e-8973-cfcae102ce99 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:47.405526 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-f6f0ebe2-ecad-4d7e-8973-cfcae102ce99 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:47.411452 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f6f0ebe2-ecad-4d7e-8973-cfcae102ce99 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:47.411899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f6f0ebe2-ecad-4d7e-8973-cfcae102ce99 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:47.412642 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f6f0ebe2-ecad-4d7e-8973-cfcae102ce99 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:47.413078 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f6f0ebe2-ecad-4d7e-8973-cfcae102ce99 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:47.421548 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-d8f8fbb4-b3be-4e6e-96aa-8950fe6b5e8d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:47.422189 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-d8f8fbb4-b3be-4e6e-96aa-8950fe6b5e8d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:47.428082 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d8f8fbb4-b3be-4e6e-96aa-8950fe6b5e8d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:47.428531 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d8f8fbb4-b3be-4e6e-96aa-8950fe6b5e8d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:47.429642 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d8f8fbb4-b3be-4e6e-96aa-8950fe6b5e8d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:47.430081 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d8f8fbb4-b3be-4e6e-96aa-8950fe6b5e8d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:47.612083 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-f6f0ebe2-ecad-4d7e-8973-cfcae102ce99 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:47.616605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-d8f8fbb4-b3be-4e6e-96aa-8950fe6b5e8d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:47.620542 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-f6f0ebe2-ecad-4d7e-8973-cfcae102ce99 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:47.622060 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-f6f0ebe2-ecad-4d7e-8973-cfcae102ce99 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:47.623201 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-f6f0ebe2-ecad-4d7e-8973-cfcae102ce99 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.222203 Jun 27 18:45:47.623766 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 48/103] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:47 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:45:47.624712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-d8f8fbb4-b3be-4e6e-96aa-8950fe6b5e8d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.207027 Jun 27 18:45:47.625271 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 56/104] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:47 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:45:47.681106 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-97d65078-d635-4756-809a-04efdb6d5953 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:47.681655 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-97d65078-d635-4756-809a-04efdb6d5953 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:47.687510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-97d65078-d635-4756-809a-04efdb6d5953 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:47.687959 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-97d65078-d635-4756-809a-04efdb6d5953 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:47.688713 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-97d65078-d635-4756-809a-04efdb6d5953 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:47.689150 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-97d65078-d635-4756-809a-04efdb6d5953 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:47.821526 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-97d65078-d635-4756-809a-04efdb6d5953 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:47.828902 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-97d65078-d635-4756-809a-04efdb6d5953 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.152082 Jun 27 18:45:47.829465 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 49/105] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:47 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:48.642755 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-2ef2e7f8-4732-43f6-89da-7e54642700f4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:48.643448 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-2ef2e7f8-4732-43f6-89da-7e54642700f4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:48.649667 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-97343709-41e3-4c23-a093-9f677f0a3c76 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:48.651025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-97343709-41e3-4c23-a093-9f677f0a3c76 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:48.657669 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2ef2e7f8-4732-43f6-89da-7e54642700f4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:48.659269 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2ef2e7f8-4732-43f6-89da-7e54642700f4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:48.660438 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2ef2e7f8-4732-43f6-89da-7e54642700f4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:48.667921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-97343709-41e3-4c23-a093-9f677f0a3c76 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:48.668816 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-97343709-41e3-4c23-a093-9f677f0a3c76 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:48.675041 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2ef2e7f8-4732-43f6-89da-7e54642700f4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:48.684390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-97343709-41e3-4c23-a093-9f677f0a3c76 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:48.685431 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-97343709-41e3-4c23-a093-9f677f0a3c76 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:49.213071 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-97343709-41e3-4c23-a093-9f677f0a3c76 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:49.234458 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-97343709-41e3-4c23-a093-9f677f0a3c76 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.595732 Jun 27 18:45:49.236079 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-2ef2e7f8-4732-43f6-89da-7e54642700f4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:49.238805 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 50/106] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:48 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:45:49.248860 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-57190dd7-9b2f-4f55-b5c3-9cd060380674 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:49.249499 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-57190dd7-9b2f-4f55-b5c3-9cd060380674 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:49.261317 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-57190dd7-9b2f-4f55-b5c3-9cd060380674 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:49.261925 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-57190dd7-9b2f-4f55-b5c3-9cd060380674 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:49.262824 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-57190dd7-9b2f-4f55-b5c3-9cd060380674 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:49.263182 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-57190dd7-9b2f-4f55-b5c3-9cd060380674 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:49.265385 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-2ef2e7f8-4732-43f6-89da-7e54642700f4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:49.275768 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-2ef2e7f8-4732-43f6-89da-7e54642700f4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:49.277077 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-2ef2e7f8-4732-43f6-89da-7e54642700f4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.639691 Jun 27 18:45:49.277667 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 57/107] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:48 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:45:49.438941 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-57190dd7-9b2f-4f55-b5c3-9cd060380674 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:49.447119 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-57190dd7-9b2f-4f55-b5c3-9cd060380674 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.207214 Jun 27 18:45:49.447704 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 51/108] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:49 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:50.251717 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-240d3d77-5ced-486d-a92c-0bfee7c5cceb tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:50.252332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-240d3d77-5ced-486d-a92c-0bfee7c5cceb tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:50.259557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-240d3d77-5ced-486d-a92c-0bfee7c5cceb tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:50.259952 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-240d3d77-5ced-486d-a92c-0bfee7c5cceb tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:50.260734 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-240d3d77-5ced-486d-a92c-0bfee7c5cceb tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:50.261320 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-240d3d77-5ced-486d-a92c-0bfee7c5cceb tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:50.296661 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a96a7ebb-bdf5-4d1d-91cd-845e56ac55b0 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:50.297975 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-a96a7ebb-bdf5-4d1d-91cd-845e56ac55b0 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:50.305580 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a96a7ebb-bdf5-4d1d-91cd-845e56ac55b0 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:50.306664 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a96a7ebb-bdf5-4d1d-91cd-845e56ac55b0 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:50.307651 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a96a7ebb-bdf5-4d1d-91cd-845e56ac55b0 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:50.308299 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a96a7ebb-bdf5-4d1d-91cd-845e56ac55b0 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:50.477272 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-240d3d77-5ced-486d-a92c-0bfee7c5cceb tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:50.488456 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-240d3d77-5ced-486d-a92c-0bfee7c5cceb tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.241058 Jun 27 18:45:50.489580 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 58/109] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:50 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:50.494397 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-747c4337-7dd4-49eb-b506-5a2abcce3000 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:50.495140 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-747c4337-7dd4-49eb-b506-5a2abcce3000 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:50.501145 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-747c4337-7dd4-49eb-b506-5a2abcce3000 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:50.501581 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-747c4337-7dd4-49eb-b506-5a2abcce3000 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:50.502334 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-747c4337-7dd4-49eb-b506-5a2abcce3000 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:50.502809 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-747c4337-7dd4-49eb-b506-5a2abcce3000 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:50.507871 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a96a7ebb-bdf5-4d1d-91cd-845e56ac55b0 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:50.518362 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a96a7ebb-bdf5-4d1d-91cd-845e56ac55b0 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:50.520129 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a96a7ebb-bdf5-4d1d-91cd-845e56ac55b0 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:50.521269 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-a96a7ebb-bdf5-4d1d-91cd-845e56ac55b0 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.229164 Jun 27 18:45:50.522915 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 52/110] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:50 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:45:50.644165 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-747c4337-7dd4-49eb-b506-5a2abcce3000 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:50.652013 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-747c4337-7dd4-49eb-b506-5a2abcce3000 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.161206 Jun 27 18:45:50.652578 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 59/111] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:50 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:51.505701 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-6a546018-af03-484a-a95a-336e5b0bdf7f tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:51.511947 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-6a546018-af03-484a-a95a-336e5b0bdf7f tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:51.515140 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6a546018-af03-484a-a95a-336e5b0bdf7f tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:51.515602 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6a546018-af03-484a-a95a-336e5b0bdf7f tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:51.516381 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6a546018-af03-484a-a95a-336e5b0bdf7f tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:51.516820 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6a546018-af03-484a-a95a-336e5b0bdf7f tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:51.541499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-0e926024-9f3a-474b-a056-d1d062d7eabd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:51.542208 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-0e926024-9f3a-474b-a056-d1d062d7eabd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:51.549592 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0e926024-9f3a-474b-a056-d1d062d7eabd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:51.550260 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0e926024-9f3a-474b-a056-d1d062d7eabd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:51.551080 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0e926024-9f3a-474b-a056-d1d062d7eabd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:51.551518 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0e926024-9f3a-474b-a056-d1d062d7eabd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:51.786897 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-6a546018-af03-484a-a95a-336e5b0bdf7f tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:51.789907 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-0e926024-9f3a-474b-a056-d1d062d7eabd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:51.797197 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-6a546018-af03-484a-a95a-336e5b0bdf7f tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.295499 Jun 27 18:45:51.802313 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-0e926024-9f3a-474b-a056-d1d062d7eabd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:51.804623 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-0e926024-9f3a-474b-a056-d1d062d7eabd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:51.806738 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 53/112] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:51 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:51.806998 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-0e926024-9f3a-474b-a056-d1d062d7eabd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.269904 Jun 27 18:45:51.808288 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 60/113] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:51 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:45:51.811589 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-2e88d2d4-6020-47c1-a417-5994badb2260 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:51.816646 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-2e88d2d4-6020-47c1-a417-5994badb2260 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:51.818163 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2e88d2d4-6020-47c1-a417-5994badb2260 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:51.818674 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2e88d2d4-6020-47c1-a417-5994badb2260 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:51.820119 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2e88d2d4-6020-47c1-a417-5994badb2260 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:51.820644 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2e88d2d4-6020-47c1-a417-5994badb2260 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:51.971817 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-2e88d2d4-6020-47c1-a417-5994badb2260 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:51.984379 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-2e88d2d4-6020-47c1-a417-5994badb2260 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.176415 Jun 27 18:45:51.994782 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 54/114] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:51 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:52.813717 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-5b8d5036-01b7-4965-8a1c-20df0ef719fa tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:52.814281 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-5b8d5036-01b7-4965-8a1c-20df0ef719fa tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:52.821780 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5b8d5036-01b7-4965-8a1c-20df0ef719fa tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:52.822225 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5b8d5036-01b7-4965-8a1c-20df0ef719fa tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:52.823029 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5b8d5036-01b7-4965-8a1c-20df0ef719fa tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:52.823459 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5b8d5036-01b7-4965-8a1c-20df0ef719fa tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:52.825600 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-efc1cb79-cf99-422e-b156-d5b6f44d07c3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:52.826452 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-efc1cb79-cf99-422e-b156-d5b6f44d07c3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:52.833439 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-efc1cb79-cf99-422e-b156-d5b6f44d07c3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:52.833892 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-efc1cb79-cf99-422e-b156-d5b6f44d07c3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:52.835242 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-efc1cb79-cf99-422e-b156-d5b6f44d07c3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:52.835701 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-efc1cb79-cf99-422e-b156-d5b6f44d07c3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:53.037161 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-5b8d5036-01b7-4965-8a1c-20df0ef719fa tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:53.040357 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-efc1cb79-cf99-422e-b156-d5b6f44d07c3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:53.057970 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-efc1cb79-cf99-422e-b156-d5b6f44d07c3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:53.065259 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-5b8d5036-01b7-4965-8a1c-20df0ef719fa tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.255161 Jun 27 18:45:53.075695 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-efc1cb79-cf99-422e-b156-d5b6f44d07c3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:53.076043 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 61/115] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:52 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:53.076141 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-efc1cb79-cf99-422e-b156-d5b6f44d07c3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.249167 Jun 27 18:45:53.087264 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 55/116] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:52 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:45:53.087864 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-6ede37c7-21b8-4bff-b9b6-b06570982abf tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:53.088533 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-6ede37c7-21b8-4bff-b9b6-b06570982abf tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:53.094354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6ede37c7-21b8-4bff-b9b6-b06570982abf tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:53.094861 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6ede37c7-21b8-4bff-b9b6-b06570982abf tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:53.095662 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6ede37c7-21b8-4bff-b9b6-b06570982abf tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:53.096305 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6ede37c7-21b8-4bff-b9b6-b06570982abf tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:53.235816 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-6ede37c7-21b8-4bff-b9b6-b06570982abf tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:53.243445 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-6ede37c7-21b8-4bff-b9b6-b06570982abf tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.174733 Jun 27 18:45:53.244059 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 62/117] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:53 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:54.083039 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-7a250c76-61c9-4201-b04b-a234ebb369a5 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:54.083648 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-7a250c76-61c9-4201-b04b-a234ebb369a5 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:54.090670 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-640459b9-6c9a-4ed0-8429-6ffcccd1ec68 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:54.091387 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7a250c76-61c9-4201-b04b-a234ebb369a5 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:54.091518 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-640459b9-6c9a-4ed0-8429-6ffcccd1ec68 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:54.091647 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7a250c76-61c9-4201-b04b-a234ebb369a5 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:54.092381 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7a250c76-61c9-4201-b04b-a234ebb369a5 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:54.092812 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7a250c76-61c9-4201-b04b-a234ebb369a5 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:54.097704 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-640459b9-6c9a-4ed0-8429-6ffcccd1ec68 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:54.098149 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-640459b9-6c9a-4ed0-8429-6ffcccd1ec68 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:54.098941 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-640459b9-6c9a-4ed0-8429-6ffcccd1ec68 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:54.099373 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-640459b9-6c9a-4ed0-8429-6ffcccd1ec68 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:54.350107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-7a250c76-61c9-4201-b04b-a234ebb369a5 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:54.355702 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-640459b9-6c9a-4ed0-8429-6ffcccd1ec68 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:54.358239 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-7a250c76-61c9-4201-b04b-a234ebb369a5 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.278990 Jun 27 18:45:54.358922 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 56/118] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:54 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:54.363790 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-bd1b01ed-b1af-4583-bce8-5490ced85cff tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:54.364340 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-640459b9-6c9a-4ed0-8429-6ffcccd1ec68 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:54.364471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-bd1b01ed-b1af-4583-bce8-5490ced85cff tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:54.369799 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-640459b9-6c9a-4ed0-8429-6ffcccd1ec68 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:54.369799 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-640459b9-6c9a-4ed0-8429-6ffcccd1ec68 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.281472 Jun 27 18:45:54.369799 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 63/119] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:54 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:45:54.371499 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bd1b01ed-b1af-4583-bce8-5490ced85cff tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:54.371950 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bd1b01ed-b1af-4583-bce8-5490ced85cff tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:54.372709 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bd1b01ed-b1af-4583-bce8-5490ced85cff tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:54.373142 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bd1b01ed-b1af-4583-bce8-5490ced85cff tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:54.530494 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-bd1b01ed-b1af-4583-bce8-5490ced85cff tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:54.538680 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-bd1b01ed-b1af-4583-bce8-5490ced85cff tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.178652 Jun 27 18:45:54.539261 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 57/120] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:54 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:55.377303 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-deaded9b-c3fd-4809-9658-98d51184037a tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:55.378861 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-deaded9b-c3fd-4809-9658-98d51184037a tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:55.386314 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-79999751-b0e1-4ffb-952b-c1f2dd409ea5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:55.387277 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-79999751-b0e1-4ffb-952b-c1f2dd409ea5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:55.392958 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-deaded9b-c3fd-4809-9658-98d51184037a tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:55.393445 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-deaded9b-c3fd-4809-9658-98d51184037a tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:55.396522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-deaded9b-c3fd-4809-9658-98d51184037a tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:55.396522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-deaded9b-c3fd-4809-9658-98d51184037a tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:55.396715 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-79999751-b0e1-4ffb-952b-c1f2dd409ea5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:55.396715 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-79999751-b0e1-4ffb-952b-c1f2dd409ea5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:55.397601 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-79999751-b0e1-4ffb-952b-c1f2dd409ea5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:55.399783 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-79999751-b0e1-4ffb-952b-c1f2dd409ea5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:55.426304 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=100 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:45:55.649542 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-deaded9b-c3fd-4809-9658-98d51184037a tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:55.661155 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-deaded9b-c3fd-4809-9658-98d51184037a tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.288076 Jun 27 18:45:55.661977 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 64/121] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:55 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:55.666206 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-79999751-b0e1-4ffb-952b-c1f2dd409ea5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:55.669764 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-5b3ba60b-860c-4685-8925-05a4d0e0b04c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:55.670588 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-5b3ba60b-860c-4685-8925-05a4d0e0b04c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:55.674435 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-79999751-b0e1-4ffb-952b-c1f2dd409ea5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:55.676802 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-79999751-b0e1-4ffb-952b-c1f2dd409ea5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:55.678178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-79999751-b0e1-4ffb-952b-c1f2dd409ea5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.296884 Jun 27 18:45:55.680901 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 58/122] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:55 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:45:55.687343 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5b3ba60b-860c-4685-8925-05a4d0e0b04c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:55.687343 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5b3ba60b-860c-4685-8925-05a4d0e0b04c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:55.687343 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5b3ba60b-860c-4685-8925-05a4d0e0b04c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:55.687343 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5b3ba60b-860c-4685-8925-05a4d0e0b04c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:55.862141 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-5b3ba60b-860c-4685-8925-05a4d0e0b04c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:55.870886 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-5b3ba60b-860c-4685-8925-05a4d0e0b04c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.206421 Jun 27 18:45:55.871461 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 65/123] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:55 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:56.679278 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-3d0b42c2-dedb-4fa4-88bb-b68e63eb09fe tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:56.679895 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-3d0b42c2-dedb-4fa4-88bb-b68e63eb09fe tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:56.682980 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell0:SELECT=2 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:45:56.686650 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3d0b42c2-dedb-4fa4-88bb-b68e63eb09fe tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:56.691129 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3d0b42c2-dedb-4fa4-88bb-b68e63eb09fe tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:56.707441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-c9d96f06-6176-43e9-932c-800cc366ce0a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:56.708553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-c9d96f06-6176-43e9-932c-800cc366ce0a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:56.715043 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3d0b42c2-dedb-4fa4-88bb-b68e63eb09fe tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:56.715507 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3d0b42c2-dedb-4fa4-88bb-b68e63eb09fe tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:56.718122 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c9d96f06-6176-43e9-932c-800cc366ce0a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:56.718990 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c9d96f06-6176-43e9-932c-800cc366ce0a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:56.721276 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c9d96f06-6176-43e9-932c-800cc366ce0a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:56.722003 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c9d96f06-6176-43e9-932c-800cc366ce0a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:56.761640 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=100 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:45:57.057634 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-3d0b42c2-dedb-4fa4-88bb-b68e63eb09fe tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:57.062687 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c9d96f06-6176-43e9-932c-800cc366ce0a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:57.065344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-3d0b42c2-dedb-4fa4-88bb-b68e63eb09fe tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.390223 Jun 27 18:45:57.065915 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 59/124] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:56 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:57.070861 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-f157c0e4-a1ee-478a-8ff2-447edbaca292 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:57.071644 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-f157c0e4-a1ee-478a-8ff2-447edbaca292 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:57.087912 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f157c0e4-a1ee-478a-8ff2-447edbaca292 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:57.088366 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c9d96f06-6176-43e9-932c-800cc366ce0a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:57.088514 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f157c0e4-a1ee-478a-8ff2-447edbaca292 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:57.089360 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f157c0e4-a1ee-478a-8ff2-447edbaca292 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:57.089805 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f157c0e4-a1ee-478a-8ff2-447edbaca292 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:57.091448 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c9d96f06-6176-43e9-932c-800cc366ce0a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:57.092936 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-c9d96f06-6176-43e9-932c-800cc366ce0a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.391900 Jun 27 18:45:57.095939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 66/125] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:56 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:45:57.264124 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-f157c0e4-a1ee-478a-8ff2-447edbaca292 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:57.271481 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-f157c0e4-a1ee-478a-8ff2-447edbaca292 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.204492 Jun 27 18:45:57.272776 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 60/126] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:57 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:58.083504 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-05748d5f-c798-4ec9-8c7a-145f891f635d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:58.084123 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-05748d5f-c798-4ec9-8c7a-145f891f635d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:58.091172 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-05748d5f-c798-4ec9-8c7a-145f891f635d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:58.091599 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-05748d5f-c798-4ec9-8c7a-145f891f635d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:58.092343 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-05748d5f-c798-4ec9-8c7a-145f891f635d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:58.092763 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-05748d5f-c798-4ec9-8c7a-145f891f635d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:58.122663 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-00f41c33-8938-4738-b23e-da7d8d23c56f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:58.124581 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-00f41c33-8938-4738-b23e-da7d8d23c56f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:58.147324 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-00f41c33-8938-4738-b23e-da7d8d23c56f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:58.153913 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-00f41c33-8938-4738-b23e-da7d8d23c56f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:58.156995 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-00f41c33-8938-4738-b23e-da7d8d23c56f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:58.157455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-00f41c33-8938-4738-b23e-da7d8d23c56f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:58.341524 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-05748d5f-c798-4ec9-8c7a-145f891f635d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:58.349652 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-05748d5f-c798-4ec9-8c7a-145f891f635d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.269814 Jun 27 18:45:58.350373 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 67/127] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:58 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:58.355566 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-3073604d-0358-47ce-b5fa-941472753f91 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:58.356395 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-3073604d-0358-47ce-b5fa-941472753f91 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:58.363244 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3073604d-0358-47ce-b5fa-941472753f91 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:58.363649 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3073604d-0358-47ce-b5fa-941472753f91 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:58.364427 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3073604d-0358-47ce-b5fa-941472753f91 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:58.364865 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3073604d-0358-47ce-b5fa-941472753f91 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:58.373478 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-00f41c33-8938-4738-b23e-da7d8d23c56f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:58.382079 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-00f41c33-8938-4738-b23e-da7d8d23c56f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:58.383640 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-00f41c33-8938-4738-b23e-da7d8d23c56f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:58.384866 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-00f41c33-8938-4738-b23e-da7d8d23c56f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.275895 Jun 27 18:45:58.385423 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 61/128] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:58 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:45:58.502974 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3073604d-0358-47ce-b5fa-941472753f91 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:58.510692 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-3073604d-0358-47ce-b5fa-941472753f91 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.159137 Jun 27 18:45:58.511265 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 68/129] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:58 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:59.367134 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-94f4fc3d-1ec1-4503-9274-05448704d850 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:59.367755 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-94f4fc3d-1ec1-4503-9274-05448704d850 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:59.374223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-94f4fc3d-1ec1-4503-9274-05448704d850 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:59.374707 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-94f4fc3d-1ec1-4503-9274-05448704d850 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:59.375473 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-94f4fc3d-1ec1-4503-9274-05448704d850 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:59.375909 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-94f4fc3d-1ec1-4503-9274-05448704d850 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:59.403593 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f54536c6-1fef-4e37-9bcd-1f19f5891678 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:59.404322 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f54536c6-1fef-4e37-9bcd-1f19f5891678 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:59.410581 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f54536c6-1fef-4e37-9bcd-1f19f5891678 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:59.411326 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f54536c6-1fef-4e37-9bcd-1f19f5891678 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:59.412185 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f54536c6-1fef-4e37-9bcd-1f19f5891678 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:59.412889 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f54536c6-1fef-4e37-9bcd-1f19f5891678 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:59.601518 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-94f4fc3d-1ec1-4503-9274-05448704d850 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:59.615161 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f54536c6-1fef-4e37-9bcd-1f19f5891678 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:59.619362 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-94f4fc3d-1ec1-4503-9274-05448704d850 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.256266 Jun 27 18:45:59.619960 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 62/130] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:59 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:45:59.640720 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f54536c6-1fef-4e37-9bcd-1f19f5891678 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:59.641110 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-17947e06-616a-4e95-ad07-5e924051408e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:45:59.641869 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-17947e06-616a-4e95-ad07-5e924051408e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:45:59.645343 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f54536c6-1fef-4e37-9bcd-1f19f5891678 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:59.646598 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f54536c6-1fef-4e37-9bcd-1f19f5891678 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.247003 Jun 27 18:45:59.649863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 69/131] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:45:59 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:45:59.651960 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-17947e06-616a-4e95-ad07-5e924051408e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:59.653201 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-17947e06-616a-4e95-ad07-5e924051408e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:59.654237 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-17947e06-616a-4e95-ad07-5e924051408e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:45:59.654983 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-17947e06-616a-4e95-ad07-5e924051408e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:45:59.791252 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-17947e06-616a-4e95-ad07-5e924051408e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:45:59.798560 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-17947e06-616a-4e95-ad07-5e924051408e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.167480 Jun 27 18:45:59.799119 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 63/132] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:45:59 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:00.638325 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-32604bd5-00c8-447a-9b2e-b61623e7af68 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:00.639045 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-32604bd5-00c8-447a-9b2e-b61623e7af68 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:00.645814 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-32604bd5-00c8-447a-9b2e-b61623e7af68 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:00.646040 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-32604bd5-00c8-447a-9b2e-b61623e7af68 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:00.647030 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-32604bd5-00c8-447a-9b2e-b61623e7af68 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:00.647644 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-32604bd5-00c8-447a-9b2e-b61623e7af68 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:00.667846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-ea03047b-d833-4e68-afcc-e0f5d01fb4f3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:00.671070 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-ea03047b-d833-4e68-afcc-e0f5d01fb4f3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:00.680776 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ea03047b-d833-4e68-afcc-e0f5d01fb4f3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:00.681662 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ea03047b-d833-4e68-afcc-e0f5d01fb4f3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:00.682770 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ea03047b-d833-4e68-afcc-e0f5d01fb4f3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:00.683500 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ea03047b-d833-4e68-afcc-e0f5d01fb4f3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:00.868478 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-32604bd5-00c8-447a-9b2e-b61623e7af68 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:00.876565 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-32604bd5-00c8-447a-9b2e-b61623e7af68 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.243323 Jun 27 18:46:00.877193 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 70/133] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:00 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:00.890990 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-19da4ac0-be9c-431d-8f86-76372d48db5c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:00.892037 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-19da4ac0-be9c-431d-8f86-76372d48db5c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:00.901467 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-19da4ac0-be9c-431d-8f86-76372d48db5c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:00.901903 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-19da4ac0-be9c-431d-8f86-76372d48db5c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:00.903001 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-19da4ac0-be9c-431d-8f86-76372d48db5c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:00.903612 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-19da4ac0-be9c-431d-8f86-76372d48db5c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:00.954529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-ea03047b-d833-4e68-afcc-e0f5d01fb4f3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:00.974142 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-ea03047b-d833-4e68-afcc-e0f5d01fb4f3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:00.978587 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-ea03047b-d833-4e68-afcc-e0f5d01fb4f3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:00.981530 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-ea03047b-d833-4e68-afcc-e0f5d01fb4f3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.319182 Jun 27 18:46:00.983336 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 64/134] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:46:00 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:46:01.197873 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-19da4ac0-be9c-431d-8f86-76372d48db5c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:01.208915 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-19da4ac0-be9c-431d-8f86-76372d48db5c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.329688 Jun 27 18:46:01.211901 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 71/135] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:00 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:01.237110 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-009da2b6-19fa-4b36-95cc-7b3958081f4a req-0d93f128-9b5c-40e8-bf37-7529ce6f5590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d", "name": "network-vif-plugged", "status": "completed", "tag": "c971b6f4-bf7c-4cee-89cc-b5e2dc176ce5"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:46:01.266241 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-009da2b6-19fa-4b36-95cc-7b3958081f4a req-0d93f128-9b5c-40e8-bf37-7529ce6f5590 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:01.267346 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-009da2b6-19fa-4b36-95cc-7b3958081f4a req-0d93f128-9b5c-40e8-bf37-7529ce6f5590 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:01.294677 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-009da2b6-19fa-4b36-95cc-7b3958081f4a req-0d93f128-9b5c-40e8-bf37-7529ce6f5590 service nova] Creating event network-vif-plugged:c971b6f4-bf7c-4cee-89cc-b5e2dc176ce5 for instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d on hv-cinder-84460 Jun 27 18:46:01.300613 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-009da2b6-19fa-4b36-95cc-7b3958081f4a req-0d93f128-9b5c-40e8-bf37-7529ce6f5590 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.315067 Jun 27 18:46:01.301755 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 65/136] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:46:01.893288 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-4e861ef9-90be-4277-a248-ee1f37a33948 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:01.894293 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-4e861ef9-90be-4277-a248-ee1f37a33948 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:01.900764 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4e861ef9-90be-4277-a248-ee1f37a33948 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:01.901240 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4e861ef9-90be-4277-a248-ee1f37a33948 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:01.902077 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4e861ef9-90be-4277-a248-ee1f37a33948 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:01.902559 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4e861ef9-90be-4277-a248-ee1f37a33948 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:02.005642 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a92acda4-7bcf-4269-943d-03c9cdfe7d8a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:02.006348 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-a92acda4-7bcf-4269-943d-03c9cdfe7d8a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:02.014268 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a92acda4-7bcf-4269-943d-03c9cdfe7d8a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:02.014630 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a92acda4-7bcf-4269-943d-03c9cdfe7d8a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:02.015554 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a92acda4-7bcf-4269-943d-03c9cdfe7d8a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:02.023197 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a92acda4-7bcf-4269-943d-03c9cdfe7d8a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:02.051780 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-4e861ef9-90be-4277-a248-ee1f37a33948 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:02.065564 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-4e861ef9-90be-4277-a248-ee1f37a33948 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.176047 Jun 27 18:46:02.066554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 72/137] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:01 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:02.159735 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a92acda4-7bcf-4269-943d-03c9cdfe7d8a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:02.167436 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a92acda4-7bcf-4269-943d-03c9cdfe7d8a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:02.169383 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a92acda4-7bcf-4269-943d-03c9cdfe7d8a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:02.170967 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-a92acda4-7bcf-4269-943d-03c9cdfe7d8a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.169479 Jun 27 18:46:02.171528 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 66/138] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:46:02 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:46:02.230833 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-22562b2c-fba1-4a7e-bcb4-e4b119017cd9 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:02.231442 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-22562b2c-fba1-4a7e-bcb4-e4b119017cd9 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:02.237480 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-22562b2c-fba1-4a7e-bcb4-e4b119017cd9 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:02.237926 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-22562b2c-fba1-4a7e-bcb4-e4b119017cd9 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:02.238698 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-22562b2c-fba1-4a7e-bcb4-e4b119017cd9 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:02.239129 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-22562b2c-fba1-4a7e-bcb4-e4b119017cd9 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:02.367346 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-22562b2c-fba1-4a7e-bcb4-e4b119017cd9 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:02.375393 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-22562b2c-fba1-4a7e-bcb4-e4b119017cd9 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.148416 Jun 27 18:46:02.376050 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 73/139] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:02 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:03.081998 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-1073b517-daab-4180-b8b8-cbfa1d6994d5 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:03.082723 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-1073b517-daab-4180-b8b8-cbfa1d6994d5 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:03.089989 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1073b517-daab-4180-b8b8-cbfa1d6994d5 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:03.092035 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1073b517-daab-4180-b8b8-cbfa1d6994d5 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:03.092922 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1073b517-daab-4180-b8b8-cbfa1d6994d5 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:03.093395 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1073b517-daab-4180-b8b8-cbfa1d6994d5 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:03.189255 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-80e33600-9b21-4a0e-9259-919616bbe111 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:03.189961 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-80e33600-9b21-4a0e-9259-919616bbe111 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:03.197494 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-80e33600-9b21-4a0e-9259-919616bbe111 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:03.197981 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-80e33600-9b21-4a0e-9259-919616bbe111 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:03.198942 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-80e33600-9b21-4a0e-9259-919616bbe111 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:03.199387 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-80e33600-9b21-4a0e-9259-919616bbe111 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:03.230434 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-1073b517-daab-4180-b8b8-cbfa1d6994d5 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:03.238259 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-1073b517-daab-4180-b8b8-cbfa1d6994d5 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.160236 Jun 27 18:46:03.239153 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 67/140] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:03 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:03.318129 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-8542650d-f432-488e-a272-db997d43729f req-b3277d5e-979e-4325-ae58-58a738c0083a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd4240ca-4c5b-441f-b4f3-659defed4c91", "name": "network-vif-plugged", "status": "completed", "tag": "41a01167-c069-4cd5-8459-b0f4a8178e28"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:46:03.327648 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-8542650d-f432-488e-a272-db997d43729f req-b3277d5e-979e-4325-ae58-58a738c0083a service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:03.328102 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-8542650d-f432-488e-a272-db997d43729f req-b3277d5e-979e-4325-ae58-58a738c0083a service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:03.345154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-80e33600-9b21-4a0e-9259-919616bbe111 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:03.354368 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-80e33600-9b21-4a0e-9259-919616bbe111 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:03.354757 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-8542650d-f432-488e-a272-db997d43729f req-b3277d5e-979e-4325-ae58-58a738c0083a service nova] Creating event network-vif-plugged:41a01167-c069-4cd5-8459-b0f4a8178e28 for instance bd4240ca-4c5b-441f-b4f3-659defed4c91 on hv-cinder-84460 Jun 27 18:46:03.355899 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-80e33600-9b21-4a0e-9259-919616bbe111 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:03.357255 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-80e33600-9b21-4a0e-9259-919616bbe111 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.171797 Jun 27 18:46:03.358014 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 74/141] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:46:03 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:46:03.360579 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-8542650d-f432-488e-a272-db997d43729f req-b3277d5e-979e-4325-ae58-58a738c0083a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046723 Jun 27 18:46:03.361178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 68/142] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:46:03.392853 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-db33a09a-c0bb-4782-8d49-28d011577055 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:03.393475 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-db33a09a-c0bb-4782-8d49-28d011577055 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:03.399898 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-db33a09a-c0bb-4782-8d49-28d011577055 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:03.400337 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-db33a09a-c0bb-4782-8d49-28d011577055 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:03.401089 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-db33a09a-c0bb-4782-8d49-28d011577055 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:03.401518 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-db33a09a-c0bb-4782-8d49-28d011577055 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:03.539220 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-db33a09a-c0bb-4782-8d49-28d011577055 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:03.546721 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-db33a09a-c0bb-4782-8d49-28d011577055 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.157632 Jun 27 18:46:03.547284 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 75/143] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:03 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:04.256455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-68755599-6cdd-4f8b-8b0b-3ce2d2f20173 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:04.257817 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-68755599-6cdd-4f8b-8b0b-3ce2d2f20173 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:04.264095 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-68755599-6cdd-4f8b-8b0b-3ce2d2f20173 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:04.264545 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-68755599-6cdd-4f8b-8b0b-3ce2d2f20173 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:04.265305 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-68755599-6cdd-4f8b-8b0b-3ce2d2f20173 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:04.265761 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-68755599-6cdd-4f8b-8b0b-3ce2d2f20173 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:04.375579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-6afc7ffb-466d-4fbd-997d-9498faf97230 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:04.376180 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-6afc7ffb-466d-4fbd-997d-9498faf97230 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:04.382281 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6afc7ffb-466d-4fbd-997d-9498faf97230 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:04.382873 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6afc7ffb-466d-4fbd-997d-9498faf97230 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:04.383679 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6afc7ffb-466d-4fbd-997d-9498faf97230 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:04.384217 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6afc7ffb-466d-4fbd-997d-9498faf97230 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:04.392878 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-68755599-6cdd-4f8b-8b0b-3ce2d2f20173 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:04.400937 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-68755599-6cdd-4f8b-8b0b-3ce2d2f20173 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.148833 Jun 27 18:46:04.401508 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 69/144] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:04 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:04.511975 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-6afc7ffb-466d-4fbd-997d-9498faf97230 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:04.519766 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-6afc7ffb-466d-4fbd-997d-9498faf97230 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:04.521259 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-6afc7ffb-466d-4fbd-997d-9498faf97230 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:04.522575 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-6afc7ffb-466d-4fbd-997d-9498faf97230 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.150988 Jun 27 18:46:04.523254 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 76/145] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:46:04 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:46:04.564094 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-dbc0b76e-6250-47ff-bca6-1d55512a0e96 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:04.564934 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-dbc0b76e-6250-47ff-bca6-1d55512a0e96 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:04.572398 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-dbc0b76e-6250-47ff-bca6-1d55512a0e96 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:04.573140 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-dbc0b76e-6250-47ff-bca6-1d55512a0e96 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:04.574399 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-dbc0b76e-6250-47ff-bca6-1d55512a0e96 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:04.575155 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-dbc0b76e-6250-47ff-bca6-1d55512a0e96 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:04.718400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-dbc0b76e-6250-47ff-bca6-1d55512a0e96 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:04.726872 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-dbc0b76e-6250-47ff-bca6-1d55512a0e96 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.166942 Jun 27 18:46:04.727411 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 70/146] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:04 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:05.376647 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-3e7f017b-4f64-4985-a5a0-4a1cbb76059e req-cc0259f8-81a3-45cd-bfbc-4af1ee11a679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91366512-6fa4-4a20-a867-94852749b02f", "name": "network-vif-plugged", "status": "completed", "tag": "3ca020b2-805d-45e4-9147-1a3d32b54834"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:46:05.385788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-3e7f017b-4f64-4985-a5a0-4a1cbb76059e req-cc0259f8-81a3-45cd-bfbc-4af1ee11a679 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:05.386288 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-3e7f017b-4f64-4985-a5a0-4a1cbb76059e req-cc0259f8-81a3-45cd-bfbc-4af1ee11a679 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:05.398214 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-3e7f017b-4f64-4985-a5a0-4a1cbb76059e req-cc0259f8-81a3-45cd-bfbc-4af1ee11a679 service nova] Creating event network-vif-plugged:3ca020b2-805d-45e4-9147-1a3d32b54834 for instance 91366512-6fa4-4a20-a867-94852749b02f on hv-cinder-84460 Jun 27 18:46:05.403621 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-3e7f017b-4f64-4985-a5a0-4a1cbb76059e req-cc0259f8-81a3-45cd-bfbc-4af1ee11a679 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031103 Jun 27 18:46:05.404196 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 77/147] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:46:05.417079 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-ef4249d5-8518-4939-b115-582f2015a9d9 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:05.417693 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-ef4249d5-8518-4939-b115-582f2015a9d9 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:05.423807 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ef4249d5-8518-4939-b115-582f2015a9d9 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:05.424261 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ef4249d5-8518-4939-b115-582f2015a9d9 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:05.425009 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ef4249d5-8518-4939-b115-582f2015a9d9 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:05.425443 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ef4249d5-8518-4939-b115-582f2015a9d9 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:05.542158 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f636ff01-e6ef-460d-acc7-183f56f98697 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:05.545256 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f636ff01-e6ef-460d-acc7-183f56f98697 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:05.559297 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f636ff01-e6ef-460d-acc7-183f56f98697 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:05.559862 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f636ff01-e6ef-460d-acc7-183f56f98697 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:05.560723 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f636ff01-e6ef-460d-acc7-183f56f98697 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:05.561499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f636ff01-e6ef-460d-acc7-183f56f98697 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:05.570769 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-ef4249d5-8518-4939-b115-582f2015a9d9 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:05.580144 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-ef4249d5-8518-4939-b115-582f2015a9d9 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.166439 Jun 27 18:46:05.580729 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 71/148] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:05 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:05.702253 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f636ff01-e6ef-460d-acc7-183f56f98697 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:05.710374 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f636ff01-e6ef-460d-acc7-183f56f98697 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:05.711974 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f636ff01-e6ef-460d-acc7-183f56f98697 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:05.713101 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f636ff01-e6ef-460d-acc7-183f56f98697 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.176116 Jun 27 18:46:05.713660 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 78/149] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:46:05 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:46:05.745621 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-5ab66556-4cc8-47c9-9a7c-6a4eaa6bc5e7 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:05.746164 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-5ab66556-4cc8-47c9-9a7c-6a4eaa6bc5e7 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:05.752304 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5ab66556-4cc8-47c9-9a7c-6a4eaa6bc5e7 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:05.753901 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5ab66556-4cc8-47c9-9a7c-6a4eaa6bc5e7 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:05.753901 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5ab66556-4cc8-47c9-9a7c-6a4eaa6bc5e7 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:05.756585 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5ab66556-4cc8-47c9-9a7c-6a4eaa6bc5e7 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:05.899618 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-5ab66556-4cc8-47c9-9a7c-6a4eaa6bc5e7 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:05.907872 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-5ab66556-4cc8-47c9-9a7c-6a4eaa6bc5e7 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.166671 Jun 27 18:46:05.918295 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 72/150] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:05 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:06.596797 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-56206b2b-c048-4d14-bfa0-0658c05babd0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:06.597414 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-56206b2b-c048-4d14-bfa0-0658c05babd0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:06.603929 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-56206b2b-c048-4d14-bfa0-0658c05babd0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:06.604366 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-56206b2b-c048-4d14-bfa0-0658c05babd0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:06.605112 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-56206b2b-c048-4d14-bfa0-0658c05babd0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:06.607010 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-56206b2b-c048-4d14-bfa0-0658c05babd0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:06.731386 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-32f66d33-a41b-4196-a275-da44c5f20969 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:06.732432 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-32f66d33-a41b-4196-a275-da44c5f20969 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:06.736734 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-56206b2b-c048-4d14-bfa0-0658c05babd0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:06.738613 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-32f66d33-a41b-4196-a275-da44c5f20969 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:06.739226 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-32f66d33-a41b-4196-a275-da44c5f20969 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:06.740156 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-32f66d33-a41b-4196-a275-da44c5f20969 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:06.742511 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-32f66d33-a41b-4196-a275-da44c5f20969 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:06.745916 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-56206b2b-c048-4d14-bfa0-0658c05babd0 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.152735 Jun 27 18:46:06.754574 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 79/151] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:06 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:06.880579 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-32f66d33-a41b-4196-a275-da44c5f20969 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:06.888859 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-32f66d33-a41b-4196-a275-da44c5f20969 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:06.890421 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-32f66d33-a41b-4196-a275-da44c5f20969 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:06.891526 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-32f66d33-a41b-4196-a275-da44c5f20969 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.164073 Jun 27 18:46:06.892081 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 73/152] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:46:06 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:46:06.924997 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-4debfb6f-395e-47dd-b3a7-be8d8b2031dd tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:06.925610 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-4debfb6f-395e-47dd-b3a7-be8d8b2031dd tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:06.932446 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4debfb6f-395e-47dd-b3a7-be8d8b2031dd tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:06.932888 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4debfb6f-395e-47dd-b3a7-be8d8b2031dd tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:06.933665 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4debfb6f-395e-47dd-b3a7-be8d8b2031dd tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:06.934091 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4debfb6f-395e-47dd-b3a7-be8d8b2031dd tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:07.223401 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-4debfb6f-395e-47dd-b3a7-be8d8b2031dd tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:07.232506 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-4debfb6f-395e-47dd-b3a7-be8d8b2031dd tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.311358 Jun 27 18:46:07.233089 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 80/153] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:06 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:07.763061 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-faca6798-635c-49e3-a5c8-32558ad1b351 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:07.763784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-faca6798-635c-49e3-a5c8-32558ad1b351 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:07.769876 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-faca6798-635c-49e3-a5c8-32558ad1b351 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:07.770321 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-faca6798-635c-49e3-a5c8-32558ad1b351 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:07.771102 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-faca6798-635c-49e3-a5c8-32558ad1b351 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:07.771535 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-faca6798-635c-49e3-a5c8-32558ad1b351 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:07.897969 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-faca6798-635c-49e3-a5c8-32558ad1b351 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:07.907539 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-faca6798-635c-49e3-a5c8-32558ad1b351 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.146108 Jun 27 18:46:07.907539 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 74/154] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:07 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:07.909475 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-0d0012c0-2959-4970-855e-2c09c61de2b2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:07.910083 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-0d0012c0-2959-4970-855e-2c09c61de2b2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:07.916508 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0d0012c0-2959-4970-855e-2c09c61de2b2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:07.916885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0d0012c0-2959-4970-855e-2c09c61de2b2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:07.917628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0d0012c0-2959-4970-855e-2c09c61de2b2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:07.918055 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0d0012c0-2959-4970-855e-2c09c61de2b2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:08.056610 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-0d0012c0-2959-4970-855e-2c09c61de2b2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:08.064653 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-0d0012c0-2959-4970-855e-2c09c61de2b2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:08.066153 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-0d0012c0-2959-4970-855e-2c09c61de2b2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:08.067338 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-0d0012c0-2959-4970-855e-2c09c61de2b2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.161718 Jun 27 18:46:08.067915 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 81/155] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:46:07 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:46:08.249006 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-b80f59cb-c933-4910-a74a-e506e50a81c8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:08.249668 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-b80f59cb-c933-4910-a74a-e506e50a81c8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:08.255615 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b80f59cb-c933-4910-a74a-e506e50a81c8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:08.256134 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b80f59cb-c933-4910-a74a-e506e50a81c8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:08.256906 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b80f59cb-c933-4910-a74a-e506e50a81c8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:08.257454 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b80f59cb-c933-4910-a74a-e506e50a81c8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:08.384478 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-b80f59cb-c933-4910-a74a-e506e50a81c8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:08.391963 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-b80f59cb-c933-4910-a74a-e506e50a81c8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.146782 Jun 27 18:46:08.392532 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 75/156] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:08 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:08.922238 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-221587f1-05ad-49e7-b305-3759c237e637 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:08.922874 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-221587f1-05ad-49e7-b305-3759c237e637 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:08.928869 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-221587f1-05ad-49e7-b305-3759c237e637 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:08.929305 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-221587f1-05ad-49e7-b305-3759c237e637 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:08.930049 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-221587f1-05ad-49e7-b305-3759c237e637 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:08.930505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-221587f1-05ad-49e7-b305-3759c237e637 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:09.058727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-221587f1-05ad-49e7-b305-3759c237e637 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:09.066039 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-221587f1-05ad-49e7-b305-3759c237e637 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.147597 Jun 27 18:46:09.066633 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 82/157] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:08 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:09.085523 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-d3fe7d99-2d3a-4b48-95da-fc645a86fb48 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:09.086138 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-d3fe7d99-2d3a-4b48-95da-fc645a86fb48 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:09.092101 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d3fe7d99-2d3a-4b48-95da-fc645a86fb48 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:09.092547 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d3fe7d99-2d3a-4b48-95da-fc645a86fb48 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:09.093302 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d3fe7d99-2d3a-4b48-95da-fc645a86fb48 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:09.093742 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d3fe7d99-2d3a-4b48-95da-fc645a86fb48 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:09.097753 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=100 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:46:09.224006 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-d3fe7d99-2d3a-4b48-95da-fc645a86fb48 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:09.232858 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-d3fe7d99-2d3a-4b48-95da-fc645a86fb48 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:09.234354 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-d3fe7d99-2d3a-4b48-95da-fc645a86fb48 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:09.235494 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-d3fe7d99-2d3a-4b48-95da-fc645a86fb48 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.154507 Jun 27 18:46:09.236044 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 76/158] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:46:09 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:46:09.408753 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7b864d0d-5a65-4cf2-a6be-49a2ad12606d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:09.409362 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-7b864d0d-5a65-4cf2-a6be-49a2ad12606d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:09.415848 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7b864d0d-5a65-4cf2-a6be-49a2ad12606d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:09.416287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7b864d0d-5a65-4cf2-a6be-49a2ad12606d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:09.417067 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7b864d0d-5a65-4cf2-a6be-49a2ad12606d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:09.417451 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7b864d0d-5a65-4cf2-a6be-49a2ad12606d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:09.551544 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-7b864d0d-5a65-4cf2-a6be-49a2ad12606d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:09.555882 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=100 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:46:09.560188 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-7b864d0d-5a65-4cf2-a6be-49a2ad12606d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.155288 Jun 27 18:46:09.560840 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 83/159] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:09 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:10.083049 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-22f304a3-3d54-41ae-9d71-cb4cfdd73b37 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:10.083712 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-22f304a3-3d54-41ae-9d71-cb4cfdd73b37 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:10.090506 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-22f304a3-3d54-41ae-9d71-cb4cfdd73b37 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:10.091147 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-22f304a3-3d54-41ae-9d71-cb4cfdd73b37 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:10.092094 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-22f304a3-3d54-41ae-9d71-cb4cfdd73b37 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:10.092543 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-22f304a3-3d54-41ae-9d71-cb4cfdd73b37 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:10.227780 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-22f304a3-3d54-41ae-9d71-cb4cfdd73b37 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:10.235530 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-22f304a3-3d54-41ae-9d71-cb4cfdd73b37 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.156321 Jun 27 18:46:10.236095 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 77/160] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:10 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:10.254162 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-564d9d8a-13ee-4de9-9e7a-e46cc109e504 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:10.254941 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-564d9d8a-13ee-4de9-9e7a-e46cc109e504 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:10.265188 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-564d9d8a-13ee-4de9-9e7a-e46cc109e504 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:10.265836 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-564d9d8a-13ee-4de9-9e7a-e46cc109e504 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:10.266634 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-564d9d8a-13ee-4de9-9e7a-e46cc109e504 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:10.267071 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-564d9d8a-13ee-4de9-9e7a-e46cc109e504 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:10.405021 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-564d9d8a-13ee-4de9-9e7a-e46cc109e504 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:10.413367 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-564d9d8a-13ee-4de9-9e7a-e46cc109e504 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:10.414575 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-564d9d8a-13ee-4de9-9e7a-e46cc109e504 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:10.415686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-564d9d8a-13ee-4de9-9e7a-e46cc109e504 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.166018 Jun 27 18:46:10.417585 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 84/161] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:46:10 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:46:10.576837 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-2adcab8c-2c8d-455f-b8f9-e54b4018a3a7 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:10.577461 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-2adcab8c-2c8d-455f-b8f9-e54b4018a3a7 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:10.583560 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2adcab8c-2c8d-455f-b8f9-e54b4018a3a7 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:10.584011 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2adcab8c-2c8d-455f-b8f9-e54b4018a3a7 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:10.584768 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2adcab8c-2c8d-455f-b8f9-e54b4018a3a7 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:10.585567 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2adcab8c-2c8d-455f-b8f9-e54b4018a3a7 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:10.714072 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-2adcab8c-2c8d-455f-b8f9-e54b4018a3a7 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:10.721521 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-2adcab8c-2c8d-455f-b8f9-e54b4018a3a7 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.148493 Jun 27 18:46:10.722085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 78/162] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:10 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:11.251301 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7cfbf62f-3176-4c10-b4e3-53edd38b758c tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:11.251943 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-7cfbf62f-3176-4c10-b4e3-53edd38b758c tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:11.259326 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7cfbf62f-3176-4c10-b4e3-53edd38b758c tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:11.260590 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7cfbf62f-3176-4c10-b4e3-53edd38b758c tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:11.261661 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7cfbf62f-3176-4c10-b4e3-53edd38b758c tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:11.262269 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7cfbf62f-3176-4c10-b4e3-53edd38b758c tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:11.397807 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-7cfbf62f-3176-4c10-b4e3-53edd38b758c tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:11.405420 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-7cfbf62f-3176-4c10-b4e3-53edd38b758c tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1315 microversion: 2.1 time: 0.157900 Jun 27 18:46:11.405987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 85/163] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:11 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:11.436942 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-dc5e1df0-8c74-4686-a1b4-47c4e3096fa4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:11.437552 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-dc5e1df0-8c74-4686-a1b4-47c4e3096fa4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:11.443416 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-dc5e1df0-8c74-4686-a1b4-47c4e3096fa4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:11.443878 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-dc5e1df0-8c74-4686-a1b4-47c4e3096fa4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:11.444838 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-dc5e1df0-8c74-4686-a1b4-47c4e3096fa4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:11.445284 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-dc5e1df0-8c74-4686-a1b4-47c4e3096fa4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:11.575177 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-dc5e1df0-8c74-4686-a1b4-47c4e3096fa4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:11.583333 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-dc5e1df0-8c74-4686-a1b4-47c4e3096fa4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:11.585371 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-dc5e1df0-8c74-4686-a1b4-47c4e3096fa4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:11.586552 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-dc5e1df0-8c74-4686-a1b4-47c4e3096fa4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.153456 Jun 27 18:46:11.587739 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 79/164] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:46:11 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:46:11.739223 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-49cd8bb8-64aa-4ac6-be68-f09ff9dcdce3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:11.739866 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-49cd8bb8-64aa-4ac6-be68-f09ff9dcdce3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:11.746590 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-49cd8bb8-64aa-4ac6-be68-f09ff9dcdce3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:11.747096 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-49cd8bb8-64aa-4ac6-be68-f09ff9dcdce3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:11.747874 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-49cd8bb8-64aa-4ac6-be68-f09ff9dcdce3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:11.752144 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-49cd8bb8-64aa-4ac6-be68-f09ff9dcdce3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:11.885913 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-49cd8bb8-64aa-4ac6-be68-f09ff9dcdce3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:11.893355 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-49cd8bb8-64aa-4ac6-be68-f09ff9dcdce3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.158120 Jun 27 18:46:11.893902 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 86/165] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:11 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:12.422671 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-1fdce054-caf8-4c88-b020-063358523a51 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:12.423289 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-1fdce054-caf8-4c88-b020-063358523a51 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:12.430036 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1fdce054-caf8-4c88-b020-063358523a51 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:12.430516 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1fdce054-caf8-4c88-b020-063358523a51 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:12.431289 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1fdce054-caf8-4c88-b020-063358523a51 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:12.431749 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1fdce054-caf8-4c88-b020-063358523a51 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:12.568609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-1fdce054-caf8-4c88-b020-063358523a51 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:12.576750 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-1fdce054-caf8-4c88-b020-063358523a51 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1503 microversion: 2.1 time: 0.157887 Jun 27 18:46:12.581518 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 80/166] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:12 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:12.610430 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-24775411-d6ff-4158-a3e9-2c37b39f00b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:12.610430 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-24775411-d6ff-4158-a3e9-2c37b39f00b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:12.613059 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-24775411-d6ff-4158-a3e9-2c37b39f00b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:12.613510 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-24775411-d6ff-4158-a3e9-2c37b39f00b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:12.614272 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-24775411-d6ff-4158-a3e9-2c37b39f00b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:12.614832 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-24775411-d6ff-4158-a3e9-2c37b39f00b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:12.751208 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-24775411-d6ff-4158-a3e9-2c37b39f00b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:12.759925 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-24775411-d6ff-4158-a3e9-2c37b39f00b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:12.761425 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-24775411-d6ff-4158-a3e9-2c37b39f00b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:12.762575 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-24775411-d6ff-4158-a3e9-2c37b39f00b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.160980 Jun 27 18:46:12.763130 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 87/167] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:46:12 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:46:12.911498 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-d6f4d5c7-2a81-46c8-9f1a-bacec2cda81c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:12.912117 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-d6f4d5c7-2a81-46c8-9f1a-bacec2cda81c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:12.918490 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d6f4d5c7-2a81-46c8-9f1a-bacec2cda81c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:12.919122 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d6f4d5c7-2a81-46c8-9f1a-bacec2cda81c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:12.919888 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d6f4d5c7-2a81-46c8-9f1a-bacec2cda81c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:12.920324 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d6f4d5c7-2a81-46c8-9f1a-bacec2cda81c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:13.063013 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-d6f4d5c7-2a81-46c8-9f1a-bacec2cda81c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:13.074231 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-d6f4d5c7-2a81-46c8-9f1a-bacec2cda81c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1362 microversion: 2.1 time: 0.165133 Jun 27 18:46:13.074231 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 81/168] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:12 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:13.780963 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a67a339c-251a-47f3-a094-e09d4b809f68 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:13.781579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a67a339c-251a-47f3-a094-e09d4b809f68 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:13.787596 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a67a339c-251a-47f3-a094-e09d4b809f68 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:13.788068 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a67a339c-251a-47f3-a094-e09d4b809f68 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:13.788826 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a67a339c-251a-47f3-a094-e09d4b809f68 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:13.789252 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a67a339c-251a-47f3-a094-e09d4b809f68 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:13.979346 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a67a339c-251a-47f3-a094-e09d4b809f68 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:13.988204 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a67a339c-251a-47f3-a094-e09d4b809f68 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:13.991349 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a67a339c-251a-47f3-a094-e09d4b809f68 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:13.992602 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a67a339c-251a-47f3-a094-e09d4b809f68 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1407 microversion: 2.20 time: 0.215551 Jun 27 18:46:13.993636 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 88/169] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:46:13 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:46:14.089401 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-95156a0f-4203-4f2b-974b-052c918f4f22 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:14.090765 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-95156a0f-4203-4f2b-974b-052c918f4f22 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:14.098013 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-95156a0f-4203-4f2b-974b-052c918f4f22 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:14.098580 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-95156a0f-4203-4f2b-974b-052c918f4f22 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:14.099414 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-95156a0f-4203-4f2b-974b-052c918f4f22 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:14.100477 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-95156a0f-4203-4f2b-974b-052c918f4f22 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:14.243602 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-95156a0f-4203-4f2b-974b-052c918f4f22 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:14.251302 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-95156a0f-4203-4f2b-974b-052c918f4f22 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1547 microversion: 2.1 time: 0.166019 Jun 27 18:46:14.264411 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 82/170] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:14 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1547 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:46:14.269451 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-63a68188-1de6-4d40-9f4f-f11354388e19 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:14.269946 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-63a68188-1de6-4d40-9f4f-f11354388e19 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:14.279312 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-63a68188-1de6-4d40-9f4f-f11354388e19 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:14.279753 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-63a68188-1de6-4d40-9f4f-f11354388e19 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:14.280530 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-63a68188-1de6-4d40-9f4f-f11354388e19 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:14.283178 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-63a68188-1de6-4d40-9f4f-f11354388e19 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:14.420954 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-63a68188-1de6-4d40-9f4f-f11354388e19 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.155499 Jun 27 18:46:14.421602 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 89/171] 10.222.0.15 () {58 vars in 1274 bytes} [Mon Jun 27 18:46:14 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:46:14.863849 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-adc65453-f6c8-45ed-be60-7ccfc82b78df tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6eba241a-482d-4a93-a6bd-3784f954e30f"}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:46:14.863849 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-adc65453-f6c8-45ed-be60-7ccfc82b78df tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:14.870175 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_api:SELECT=76 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:46:14.872106 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-adc65453-f6c8-45ed-be60-7ccfc82b78df tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:14.872715 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-adc65453-f6c8-45ed-be60-7ccfc82b78df tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:14.873696 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-adc65453-f6c8-45ed-be60-7ccfc82b78df tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:14.874285 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-adc65453-f6c8-45ed-be60-7ccfc82b78df tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:15.010743 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-b0c5d9d4-aec4-4c1b-a2d8-7607f99b465c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:15.011536 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-b0c5d9d4-aec4-4c1b-a2d8-7607f99b465c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:15.013461 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_api:SELECT=80 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:46:15.024094 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b0c5d9d4-aec4-4c1b-a2d8-7607f99b465c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:15.026163 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b0c5d9d4-aec4-4c1b-a2d8-7607f99b465c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:15.027159 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b0c5d9d4-aec4-4c1b-a2d8-7607f99b465c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:15.031305 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b0c5d9d4-aec4-4c1b-a2d8-7607f99b465c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:15.564376 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-b0c5d9d4-aec4-4c1b-a2d8-7607f99b465c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:15.572650 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-b0c5d9d4-aec4-4c1b-a2d8-7607f99b465c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:15.574219 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-b0c5d9d4-aec4-4c1b-a2d8-7607f99b465c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:15.575012 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-b0c5d9d4-aec4-4c1b-a2d8-7607f99b465c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1599 microversion: 2.20 time: 0.569287 Jun 27 18:46:15.575565 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 90/172] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:46:15 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1599 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:46:15.596799 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-999ceb60-f4af-4b53-b66c-350dc55ac3c8 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:15.597538 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-999ceb60-f4af-4b53-b66c-350dc55ac3c8 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:15.607323 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-999ceb60-f4af-4b53-b66c-350dc55ac3c8 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:15.607788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-999ceb60-f4af-4b53-b66c-350dc55ac3c8 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:15.608588 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-999ceb60-f4af-4b53-b66c-350dc55ac3c8 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:15.609023 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-999ceb60-f4af-4b53-b66c-350dc55ac3c8 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:15.712473 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-999ceb60-f4af-4b53-b66c-350dc55ac3c8 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.122753 Jun 27 18:46:15.713446 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 91/173] 10.222.0.15 () {60 vars in 1315 bytes} [Mon Jun 27 18:46:15 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f/os-interface => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 18:46:16.515610 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-adc65453-f6c8-45ed-be60-7ccfc82b78df tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "POST /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.662233 Jun 27 18:46:16.523378 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 83/174] 10.222.0.15 () {60 vars in 1322 bytes} [Mon Jun 27 18:46:14 2022] POST /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d/os-volume_attachments => generated 194 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:46:16.523543 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-f1d9fc3e-f522-49d8-9d2f-71e80d310289 req-21dfafb6-71f9-434b-8a83-c03be56c3120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd4240ca-4c5b-441f-b4f3-659defed4c91", "tag": "41a01167-c069-4cd5-8459-b0f4a8178e28"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:46:16.547377 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-f1d9fc3e-f522-49d8-9d2f-71e80d310289 req-21dfafb6-71f9-434b-8a83-c03be56c3120 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:16.547377 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-f1d9fc3e-f522-49d8-9d2f-71e80d310289 req-21dfafb6-71f9-434b-8a83-c03be56c3120 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:16.585477 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-f1d9fc3e-f522-49d8-9d2f-71e80d310289 req-21dfafb6-71f9-434b-8a83-c03be56c3120 service nova] Creating event network-changed:41a01167-c069-4cd5-8459-b0f4a8178e28 for instance bd4240ca-4c5b-441f-b4f3-659defed4c91 on hv-cinder-84460 Jun 27 18:46:16.602054 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-f1d9fc3e-f522-49d8-9d2f-71e80d310289 req-21dfafb6-71f9-434b-8a83-c03be56c3120 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088595 Jun 27 18:46:16.606217 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 92/175] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:46:18.160162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-e8794758-fafa-4dd3-bab3-1aaf645a453e req-0e44d040-46d8-40ab-9567-28c3481ef65d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91366512-6fa4-4a20-a867-94852749b02f", "tag": "3ca020b2-805d-45e4-9147-1a3d32b54834"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:46:18.196595 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-e8794758-fafa-4dd3-bab3-1aaf645a453e req-0e44d040-46d8-40ab-9567-28c3481ef65d service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:18.199755 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-e8794758-fafa-4dd3-bab3-1aaf645a453e req-0e44d040-46d8-40ab-9567-28c3481ef65d service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:18.246852 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-e8794758-fafa-4dd3-bab3-1aaf645a453e req-0e44d040-46d8-40ab-9567-28c3481ef65d service nova] Creating event network-changed:3ca020b2-805d-45e4-9147-1a3d32b54834 for instance 91366512-6fa4-4a20-a867-94852749b02f on hv-cinder-84460 Jun 27 18:46:18.255797 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-e8794758-fafa-4dd3-bab3-1aaf645a453e req-0e44d040-46d8-40ab-9567-28c3481ef65d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101728 Jun 27 18:46:18.270119 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 84/176] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:46:25.844965 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a90c8fe4-4e52-4e94-88df-b814073a1f40 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:25.845553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a90c8fe4-4e52-4e94-88df-b814073a1f40 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:25.851852 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a90c8fe4-4e52-4e94-88df-b814073a1f40 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:25.852300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a90c8fe4-4e52-4e94-88df-b814073a1f40 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:25.853061 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a90c8fe4-4e52-4e94-88df-b814073a1f40 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:25.853496 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a90c8fe4-4e52-4e94-88df-b814073a1f40 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:25.878770 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a90c8fe4-4e52-4e94-88df-b814073a1f40 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Going to try to terminate instance {{(pid=124716) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 18:46:26.174630 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a90c8fe4-4e52-4e94-88df-b814073a1f40 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 204 len: 0 microversion: 2.1 time: 0.333831 Jun 27 18:46:26.175238 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 93/177] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:46:25 2022] DELETE /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 18:46:26.185246 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-3e470591-76ae-4461-9473-bf4a53989f08 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:26.185959 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-3e470591-76ae-4461-9473-bf4a53989f08 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:26.192097 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3e470591-76ae-4461-9473-bf4a53989f08 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:26.192553 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3e470591-76ae-4461-9473-bf4a53989f08 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:26.193524 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3e470591-76ae-4461-9473-bf4a53989f08 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:26.194056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3e470591-76ae-4461-9473-bf4a53989f08 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:26.342556 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-3e470591-76ae-4461-9473-bf4a53989f08 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:26.352062 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-3e470591-76ae-4461-9473-bf4a53989f08 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1555 microversion: 2.1 time: 0.171643 Jun 27 18:46:26.352637 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 85/178] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:26 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:27.370574 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-5cb81768-e893-46eb-ad2f-7379dcdd6973 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:27.371265 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-5cb81768-e893-46eb-ad2f-7379dcdd6973 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:27.377371 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5cb81768-e893-46eb-ad2f-7379dcdd6973 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:27.377817 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5cb81768-e893-46eb-ad2f-7379dcdd6973 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:27.378603 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5cb81768-e893-46eb-ad2f-7379dcdd6973 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:27.379039 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5cb81768-e893-46eb-ad2f-7379dcdd6973 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:27.539272 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-5cb81768-e893-46eb-ad2f-7379dcdd6973 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:27.547381 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-5cb81768-e893-46eb-ad2f-7379dcdd6973 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1555 microversion: 2.1 time: 0.181207 Jun 27 18:46:27.547942 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 94/179] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:27 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:28.564000 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e264f71b-f8a9-40f5-af81-a8f7facef042 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:28.565036 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e264f71b-f8a9-40f5-af81-a8f7facef042 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:28.572247 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e264f71b-f8a9-40f5-af81-a8f7facef042 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:28.572687 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e264f71b-f8a9-40f5-af81-a8f7facef042 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:28.573446 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e264f71b-f8a9-40f5-af81-a8f7facef042 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:28.573878 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e264f71b-f8a9-40f5-af81-a8f7facef042 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:28.707558 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-e264f71b-f8a9-40f5-af81-a8f7facef042 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:28.716097 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e264f71b-f8a9-40f5-af81-a8f7facef042 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1555 microversion: 2.1 time: 0.155997 Jun 27 18:46:28.716690 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 86/180] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:28 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:29.733305 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-93ac65ee-6762-4958-9a5b-289f2419a8e7 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:29.733930 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-93ac65ee-6762-4958-9a5b-289f2419a8e7 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:29.742178 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-93ac65ee-6762-4958-9a5b-289f2419a8e7 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:29.748482 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-93ac65ee-6762-4958-9a5b-289f2419a8e7 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:29.748482 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-93ac65ee-6762-4958-9a5b-289f2419a8e7 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:29.748482 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-93ac65ee-6762-4958-9a5b-289f2419a8e7 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:29.932227 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-93ac65ee-6762-4958-9a5b-289f2419a8e7 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:29.942155 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-93ac65ee-6762-4958-9a5b-289f2419a8e7 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1555 microversion: 2.1 time: 0.212983 Jun 27 18:46:29.946015 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 95/181] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:29 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1555 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:30.965909 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-cd3c9f19-38d0-44ef-91b2-f44404a2aa52 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:30.966699 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-cd3c9f19-38d0-44ef-91b2-f44404a2aa52 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:30.973500 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cd3c9f19-38d0-44ef-91b2-f44404a2aa52 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:30.976283 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cd3c9f19-38d0-44ef-91b2-f44404a2aa52 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:30.976283 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cd3c9f19-38d0-44ef-91b2-f44404a2aa52 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:30.976283 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cd3c9f19-38d0-44ef-91b2-f44404a2aa52 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:31.151957 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-cd3c9f19-38d0-44ef-91b2-f44404a2aa52 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:31.160110 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-cd3c9f19-38d0-44ef-91b2-f44404a2aa52 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1555 microversion: 2.1 time: 0.197973 Jun 27 18:46:31.160755 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 87/182] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:30 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1555 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:32.012886 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-e76fccd5-203a-4752-921f-191f91ee626b req-a431252d-cf46-46db-be20-eed79bc27800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d", "name": "network-vif-deleted", "tag": "c971b6f4-bf7c-4cee-89cc-b5e2dc176ce5"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:46:32.013501 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-e76fccd5-203a-4752-921f-191f91ee626b req-a431252d-cf46-46db-be20-eed79bc27800 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:32.013955 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-e76fccd5-203a-4752-921f-191f91ee626b req-a431252d-cf46-46db-be20-eed79bc27800 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:32.026922 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-e76fccd5-203a-4752-921f-191f91ee626b req-a431252d-cf46-46db-be20-eed79bc27800 service nova] Creating event network-vif-deleted:c971b6f4-bf7c-4cee-89cc-b5e2dc176ce5 for instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d on hv-cinder-84460 Jun 27 18:46:32.032172 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-e76fccd5-203a-4752-921f-191f91ee626b req-a431252d-cf46-46db-be20-eed79bc27800 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032967 Jun 27 18:46:32.032766 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 96/183] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:46:32.179558 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-93a743dc-c39a-4d47-a362-b68303066d68 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:32.180376 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-93a743dc-c39a-4d47-a362-b68303066d68 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:32.187116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-93a743dc-c39a-4d47-a362-b68303066d68 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:32.187512 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-93a743dc-c39a-4d47-a362-b68303066d68 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:32.188267 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-93a743dc-c39a-4d47-a362-b68303066d68 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:32.188712 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-93a743dc-c39a-4d47-a362-b68303066d68 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:32.261729 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-93a743dc-c39a-4d47-a362-b68303066d68 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:32.276500 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-93a743dc-c39a-4d47-a362-b68303066d68 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1513 microversion: 2.1 time: 0.097728 Jun 27 18:46:32.276500 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 88/184] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:32 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1513 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:33.295942 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f6b19ff2-d5f0-4e82-afae-ae7d77add58e tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:33.301368 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f6b19ff2-d5f0-4e82-afae-ae7d77add58e tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:33.307627 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f6b19ff2-d5f0-4e82-afae-ae7d77add58e tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:33.308086 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f6b19ff2-d5f0-4e82-afae-ae7d77add58e tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:33.308857 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f6b19ff2-d5f0-4e82-afae-ae7d77add58e tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:33.309528 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f6b19ff2-d5f0-4e82-afae-ae7d77add58e tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:33.416381 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f6b19ff2-d5f0-4e82-afae-ae7d77add58e tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:33.432330 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f6b19ff2-d5f0-4e82-afae-ae7d77add58e tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1346 microversion: 2.1 time: 0.139494 Jun 27 18:46:33.433294 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 97/185] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:33 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1346 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:34.453508 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-6b9ad3e5-b5b2-4bf7-98bd-c2cf3ad36ce7 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:34.454231 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-6b9ad3e5-b5b2-4bf7-98bd-c2cf3ad36ce7 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:34.462200 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6b9ad3e5-b5b2-4bf7-98bd-c2cf3ad36ce7 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:34.462736 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6b9ad3e5-b5b2-4bf7-98bd-c2cf3ad36ce7 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:34.467180 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6b9ad3e5-b5b2-4bf7-98bd-c2cf3ad36ce7 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:34.467676 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6b9ad3e5-b5b2-4bf7-98bd-c2cf3ad36ce7 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:34.517520 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6b9ad3e5-b5b2-4bf7-98bd-c2cf3ad36ce7 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:34.517983 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6b9ad3e5-b5b2-4bf7-98bd-c2cf3ad36ce7 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:34.518528 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.objects.instance [None req-6b9ad3e5-b5b2-4bf7-98bd-c2cf3ad36ce7 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lazy-loading 'fault' on Instance uuid f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d {{(pid=124717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:46:34.572515 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-6b9ad3e5-b5b2-4bf7-98bd-c2cf3ad36ce7 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daef56aadd1c4edfa6eeadea63050d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a70eb47fed4e959fc51400ddc3caf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:34.580978 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-6b9ad3e5-b5b2-4bf7-98bd-c2cf3ad36ce7 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 200 len: 1351 microversion: 2.1 time: 0.131259 Jun 27 18:46:34.581875 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 89/186] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:34 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 1351 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:35.599957 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-b46b4b58-3cf7-4052-b956-6ae8d2bfdee9 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:35.600736 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-b46b4b58-3cf7-4052-b956-6ae8d2bfdee9 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:35.606949 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b46b4b58-3cf7-4052-b956-6ae8d2bfdee9 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:35.608385 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b46b4b58-3cf7-4052-b956-6ae8d2bfdee9 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:35.608385 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b46b4b58-3cf7-4052-b956-6ae8d2bfdee9 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:35.608584 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b46b4b58-3cf7-4052-b956-6ae8d2bfdee9 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:35.622746 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-b46b4b58-3cf7-4052-b956-6ae8d2bfdee9 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] HTTP exception thrown: Instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d could not be found. Jun 27 18:46:35.627331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-b46b4b58-3cf7-4052-b956-6ae8d2bfdee9 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Request method failure captured: Jun 27 18:46:35.627331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d HTTP/1.1 Jun 27 18:46:35.627331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:46:35.627331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:46:35.627331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:46:35.627331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:46:35.627331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:46:35.627331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:46:35.627331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:46:35.627331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:46:35.627331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufq-JvdJT253znOtF04V3chEEHVvjZ04AjfdnDdD-mKqhy_aEMaCLAYm25ul9epa0G4TpOk4Lk3G40bMBd97wHzjQsgNa0Td3WEG06VTwqVKmsducqZ_cxQxPm4n2peDsF7hT3G1JrDJN9WwSgdzY2GvePfQ6itYOoftMALWXHOcatA Jun 27 18:46:35.627331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:46:35.627331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:46:35.627331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:46:35.627331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:46:35.627331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:46:35.627331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:46:35.627331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: f3a70eb47fed4e959fc51400ddc3caf1 Jun 27 18:46:35.627331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-DeleteServersTestJSON-1565088084 Jun 27 18:46:35.627331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:46:35.627331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:46:35.628859 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f3a70eb47fed4e959fc51400ddc3caf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f3a70eb47fed4e959fc51400ddc3caf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f3a70eb47fed4e959fc51400ddc3caf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f3a70eb47fed4e959fc51400ddc3caf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:46:35.628859 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-DeleteServersTestJSON-1565088084 Jun 27 18:46:35.628859 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: f3a70eb47fed4e959fc51400ddc3caf1 Jun 27 18:46:35.628859 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-DeleteServersTestJSON-1565088084 Jun 27 18:46:35.628859 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-DeleteServersTestJSON-1565088084-project Jun 27 18:46:35.628859 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:46:35.628859 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:46:35.628859 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: daef56aadd1c4edfa6eeadea63050d37 Jun 27 18:46:35.628859 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-DeleteServersTestJSON-1565088084-project Jun 27 18:46:35.628859 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: > Jun 27 18:46:35.628859 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d could not be found. Jun 27 18:46:35.628859 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': 'f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d'} Jun 27 18:46:35.629707 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:46:35.629707 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:46:35.629707 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:46:35.629707 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:46:35.629707 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:46:35.629707 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:46:35.629707 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:46:35.629707 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:46:35.629707 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:46:35.629707 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:46:35.629707 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d could not be found. Jun 27 18:46:35.629707 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:46:35.629707 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:46:35.629707 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:46:35.629707 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:46:35.629707 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:46:35.629707 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:46:35.629707 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:46:35.629707 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:46:35.629707 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:46:35.631209 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:46:35.631209 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:46:35.631209 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:46:35.631209 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:46:35.631209 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:46:35.631209 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:46:35.631209 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:46:35.631209 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d could not be found. Jun 27 18:46:35.631209 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:46:35.631209 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:46:35.631209 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:46:35.631209 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:46:35.631209 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:46:35.631209 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:46:35.631209 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:46:35.631209 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:46:35.631209 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d could not be found. Jun 27 18:46:35.631209 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:46:35.632334 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-b46b4b58-3cf7-4052-b956-6ae8d2bfdee9 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Returning 404 to user: Instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:46:35.632334 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-b46b4b58-3cf7-4052-b956-6ae8d2bfdee9 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 404 len: 111 microversion: 2.1 time: 0.033354 Jun 27 18:46:35.632334 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 98/187] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:35 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:46:36.546189 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-76f69452-80e4-4d87-847c-52ca7ef2548d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:36.547215 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-76f69452-80e4-4d87-847c-52ca7ef2548d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:36.554748 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-76f69452-80e4-4d87-847c-52ca7ef2548d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:36.555198 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-76f69452-80e4-4d87-847c-52ca7ef2548d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:36.555966 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-76f69452-80e4-4d87-847c-52ca7ef2548d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:36.556413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-76f69452-80e4-4d87-847c-52ca7ef2548d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:36.569574 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-76f69452-80e4-4d87-847c-52ca7ef2548d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] HTTP exception thrown: Instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d could not be found. Jun 27 18:46:36.573700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-76f69452-80e4-4d87-847c-52ca7ef2548d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Request method failure captured: Jun 27 18:46:36.573700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d/os-volume_attachments HTTP/1.1 Jun 27 18:46:36.573700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 18:46:36.573700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 18:46:36.573700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 18:46:36.573700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 0 Jun 27 18:46:36.573700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 18:46:36.573700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 18:46:36.573700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 18:46:36.573700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 18:46:36.573700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufq-JvdJT253znOtF04V3chEEHVvjZ04AjfdnDdD-mKqhy_aEMaCLAYm25ul9epa0G4TpOk4Lk3G40bMBd97wHzjQsgNa0Td3WEG06VTwqVKmsducqZ_cxQxPm4n2peDsF7hT3G1JrDJN9WwSgdzY2GvePfQ6itYOoftMALWXHOcatA Jun 27 18:46:36.573700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 18:46:36.573700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 18:46:36.573700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 18:46:36.573700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 18:46:36.573700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 18:46:36.573700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 18:46:36.573700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: f3a70eb47fed4e959fc51400ddc3caf1 Jun 27 18:46:36.573700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-DeleteServersTestJSON-1565088084 Jun 27 18:46:36.573700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 18:46:36.573700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 18:46:36.575238 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f3a70eb47fed4e959fc51400ddc3caf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f3a70eb47fed4e959fc51400ddc3caf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f3a70eb47fed4e959fc51400ddc3caf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f3a70eb47fed4e959fc51400ddc3caf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:46:36.575238 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-DeleteServersTestJSON-1565088084 Jun 27 18:46:36.575238 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: f3a70eb47fed4e959fc51400ddc3caf1 Jun 27 18:46:36.575238 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-DeleteServersTestJSON-1565088084 Jun 27 18:46:36.575238 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-DeleteServersTestJSON-1565088084-project Jun 27 18:46:36.575238 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 18:46:36.575238 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 18:46:36.575238 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: daef56aadd1c4edfa6eeadea63050d37 Jun 27 18:46:36.575238 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-DeleteServersTestJSON-1565088084-project Jun 27 18:46:36.575238 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: > Jun 27 18:46:36.575238 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d could not be found. Jun 27 18:46:36.575238 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'server_id': 'f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d'} Jun 27 18:46:36.576023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:46:36.576023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:46:36.576023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:46:36.576023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:46:36.576023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:46:36.576023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:46:36.576023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:46:36.576023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:46:36.576023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:46:36.576023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:46:36.576023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d could not be found. Jun 27 18:46:36.576023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:46:36.576023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:46:36.576023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:46:36.576023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:46:36.576023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:46:36.576023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:46:36.576023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:46:36.576023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:46:36.576023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:46:36.577294 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:46:36.577294 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 27 18:46:36.577294 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 18:46:36.577294 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 27 18:46:36.577294 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 18:46:36.577294 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 27 18:46:36.577294 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 27 18:46:36.577294 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:46:36.577294 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:46:36.577294 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d could not be found. Jun 27 18:46:36.577294 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:46:36.577294 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:46:36.577294 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:46:36.577294 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:46:36.577294 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:46:36.577294 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:46:36.577294 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:46:36.577294 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:46:36.577294 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d could not be found. Jun 27 18:46:36.577294 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:46:36.578599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-76f69452-80e4-4d87-847c-52ca7ef2548d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Returning 404 to user: Instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d could not be found. {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:46:36.578599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-76f69452-80e4-4d87-847c-52ca7ef2548d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032919 Jun 27 18:46:36.578599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 90/188] 10.222.0.15 () {58 vars in 1301 bytes} [Mon Jun 27 18:46:36 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 18:46:41.562015 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-b3cf7c96-7651-4acc-b55e-59b5c67e3e1d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:41.564982 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-b3cf7c96-7651-4acc-b55e-59b5c67e3e1d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:41.584705 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b3cf7c96-7651-4acc-b55e-59b5c67e3e1d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:41.585230 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b3cf7c96-7651-4acc-b55e-59b5c67e3e1d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:41.586115 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b3cf7c96-7651-4acc-b55e-59b5c67e3e1d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:41.586451 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b3cf7c96-7651-4acc-b55e-59b5c67e3e1d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:41.592269 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:46:41.603515 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-b3cf7c96-7651-4acc-b55e-59b5c67e3e1d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] HTTP exception thrown: Instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d could not be found. Jun 27 18:46:41.605138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-b3cf7c96-7651-4acc-b55e-59b5c67e3e1d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Request method failure captured: Jun 27 18:46:41.605138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: DELETE /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d HTTP/1.1 Jun 27 18:46:41.605138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:46:41.605138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:46:41.605138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:46:41.605138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:46:41.605138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:46:41.605138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:46:41.605138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:46:41.605138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:46:41.605138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufq-JvdJT253znOtF04V3chEEHVvjZ04AjfdnDdD-mKqhy_aEMaCLAYm25ul9epa0G4TpOk4Lk3G40bMBd97wHzjQsgNa0Td3WEG06VTwqVKmsducqZ_cxQxPm4n2peDsF7hT3G1JrDJN9WwSgdzY2GvePfQ6itYOoftMALWXHOcatA Jun 27 18:46:41.605138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:46:41.605138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:46:41.605138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:46:41.605138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:46:41.605138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:46:41.605138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:46:41.605138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: f3a70eb47fed4e959fc51400ddc3caf1 Jun 27 18:46:41.605138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-DeleteServersTestJSON-1565088084 Jun 27 18:46:41.605138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:46:41.605138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:46:41.607688 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f3a70eb47fed4e959fc51400ddc3caf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f3a70eb47fed4e959fc51400ddc3caf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f3a70eb47fed4e959fc51400ddc3caf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f3a70eb47fed4e959fc51400ddc3caf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:46:41.607688 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-DeleteServersTestJSON-1565088084 Jun 27 18:46:41.607688 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: f3a70eb47fed4e959fc51400ddc3caf1 Jun 27 18:46:41.607688 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-DeleteServersTestJSON-1565088084 Jun 27 18:46:41.607688 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-DeleteServersTestJSON-1565088084-project Jun 27 18:46:41.607688 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:46:41.607688 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:46:41.607688 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: daef56aadd1c4edfa6eeadea63050d37 Jun 27 18:46:41.607688 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-DeleteServersTestJSON-1565088084-project Jun 27 18:46:41.607688 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: > Jun 27 18:46:41.607688 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d could not be found. Jun 27 18:46:41.607688 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': 'f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d'} Jun 27 18:46:41.608553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:46:41.608553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:46:41.608553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:46:41.608553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:46:41.608553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:46:41.608553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:46:41.608553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:46:41.608553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:46:41.608553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:46:41.608553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:46:41.608553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d could not be found. Jun 27 18:46:41.608553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:46:41.608553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:46:41.608553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:46:41.608553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:46:41.608553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:46:41.608553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:46:41.608553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:46:41.608553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:46:41.608553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:46:41.609863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:46:41.609863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 18:46:41.609863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 18:46:41.609863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 18:46:41.609863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 18:46:41.609863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:46:41.609863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:46:41.609863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:46:41.609863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:46:41.609863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d could not be found. Jun 27 18:46:41.609863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:46:41.609863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:46:41.609863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:46:41.609863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:46:41.609863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:46:41.609863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:46:41.609863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:46:41.609863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:46:41.609863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d could not be found. Jun 27 18:46:41.609863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:46:41.611514 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-b3cf7c96-7651-4acc-b55e-59b5c67e3e1d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Returning 404 to user: Instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:46:41.611514 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-b3cf7c96-7651-4acc-b55e-59b5c67e3e1d tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 404 len: 111 microversion: 2.1 time: 0.050439 Jun 27 18:46:41.611514 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 99/189] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:46:41 2022] DELETE /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:46:41.616966 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-3f011efe-96e8-4f75-9e40-02bba3abbaa1 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:41.617599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-3f011efe-96e8-4f75-9e40-02bba3abbaa1 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] [instance: f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:41.625867 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3f011efe-96e8-4f75-9e40-02bba3abbaa1 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:41.625867 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3f011efe-96e8-4f75-9e40-02bba3abbaa1 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:41.637965 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3f011efe-96e8-4f75-9e40-02bba3abbaa1 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:41.638568 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3f011efe-96e8-4f75-9e40-02bba3abbaa1 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:41.641471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:46:41.667855 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-3f011efe-96e8-4f75-9e40-02bba3abbaa1 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] HTTP exception thrown: Instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d could not be found. Jun 27 18:46:41.671002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-3f011efe-96e8-4f75-9e40-02bba3abbaa1 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Request method failure captured: Jun 27 18:46:41.671002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d HTTP/1.1 Jun 27 18:46:41.671002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 18:46:41.671002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 18:46:41.671002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 18:46:41.671002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 0 Jun 27 18:46:41.671002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 18:46:41.671002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 18:46:41.671002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 18:46:41.671002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 18:46:41.671002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufq-JvdJT253znOtF04V3chEEHVvjZ04AjfdnDdD-mKqhy_aEMaCLAYm25ul9epa0G4TpOk4Lk3G40bMBd97wHzjQsgNa0Td3WEG06VTwqVKmsducqZ_cxQxPm4n2peDsF7hT3G1JrDJN9WwSgdzY2GvePfQ6itYOoftMALWXHOcatA Jun 27 18:46:41.671002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 18:46:41.671002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 18:46:41.671002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 18:46:41.671002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 18:46:41.671002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 18:46:41.671002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 18:46:41.671002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: f3a70eb47fed4e959fc51400ddc3caf1 Jun 27 18:46:41.671002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-DeleteServersTestJSON-1565088084 Jun 27 18:46:41.671002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 18:46:41.671002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 18:46:41.678278 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f3a70eb47fed4e959fc51400ddc3caf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f3a70eb47fed4e959fc51400ddc3caf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f3a70eb47fed4e959fc51400ddc3caf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f3a70eb47fed4e959fc51400ddc3caf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:46:41.678278 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-DeleteServersTestJSON-1565088084 Jun 27 18:46:41.678278 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: f3a70eb47fed4e959fc51400ddc3caf1 Jun 27 18:46:41.678278 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-DeleteServersTestJSON-1565088084 Jun 27 18:46:41.678278 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-DeleteServersTestJSON-1565088084-project Jun 27 18:46:41.678278 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 18:46:41.678278 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 18:46:41.678278 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: daef56aadd1c4edfa6eeadea63050d37 Jun 27 18:46:41.678278 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-DeleteServersTestJSON-1565088084-project Jun 27 18:46:41.678278 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: > Jun 27 18:46:41.678278 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d could not be found. Jun 27 18:46:41.678278 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'id': 'f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d'} Jun 27 18:46:41.679223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:46:41.679223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:46:41.679223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:46:41.679223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:46:41.679223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:46:41.679223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:46:41.679223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:46:41.679223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:46:41.679223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:46:41.679223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:46:41.679223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d could not be found. Jun 27 18:46:41.679223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:46:41.679223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:46:41.679223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:46:41.679223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:46:41.679223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:46:41.679223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:46:41.679223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:46:41.679223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:46:41.679223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:46:41.680529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:46:41.680529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:46:41.680529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:46:41.680529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:46:41.680529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:46:41.680529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:46:41.680529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:46:41.680529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d could not be found. Jun 27 18:46:41.680529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:46:41.680529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:46:41.680529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:46:41.680529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:46:41.680529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:46:41.680529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:46:41.680529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:46:41.680529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:46:41.680529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d could not be found. Jun 27 18:46:41.680529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:46:41.681670 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-3f011efe-96e8-4f75-9e40-02bba3abbaa1 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] Returning 404 to user: Instance f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d could not be found. {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:46:41.681670 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-3f011efe-96e8-4f75-9e40-02bba3abbaa1 tempest-DeleteServersTestJSON-1565088084 tempest-DeleteServersTestJSON-1565088084-project] 10.222.0.15 "GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d" status: 404 len: 111 microversion: 2.1 time: 0.061281 Jun 27 18:46:41.681670 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 91/190] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:41 2022] GET /compute/v2.1/servers/f30eb0c8-2fc9-4cbe-8d3f-f7cbea38505d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:46:54.719572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-b0ee6d73-ac5d-4746-81a2-7c55a9449a05 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:54.720116 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-b0ee6d73-ac5d-4746-81a2-7c55a9449a05 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:54.722365 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:46:54.728164 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b0ee6d73-ac5d-4746-81a2-7c55a9449a05 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:54.728609 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b0ee6d73-ac5d-4746-81a2-7c55a9449a05 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:54.729364 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b0ee6d73-ac5d-4746-81a2-7c55a9449a05 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:54.729963 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b0ee6d73-ac5d-4746-81a2-7c55a9449a05 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:54.768900 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-b0ee6d73-ac5d-4746-81a2-7c55a9449a05 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f/ips" status: 200 len: 151 microversion: 2.20 time: 0.053285 Jun 27 18:46:54.769480 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 100/191] 10.222.0.15 () {60 vars in 1288 bytes} [Mon Jun 27 18:46:54 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f/ips => generated 151 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 18:46:56.302129 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_api:SELECT=19 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:46:56.418605 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-853fb00d-798a-49f0-902d-89d28088d3b0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1832856121", "imageRef": "c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:46:56.473146 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.network.neutron [None req-853fb00d-798a-49f0-902d-89d28088d3b0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] validate_networks() for [('2f67bf90-aaaf-40ed-b8c3-5bdd36fb3e3d', None, None, None, None, None)] {{(pid=124717) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 18:46:56.866108 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-853fb00d-798a-49f0-902d-89d28088d3b0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Flavor limits 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 18:46:56.866912 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-853fb00d-798a-49f0-902d-89d28088d3b0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Image limits 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 18:46:56.867394 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-853fb00d-798a-49f0-902d-89d28088d3b0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Flavor pref 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 18:46:56.867802 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-853fb00d-798a-49f0-902d-89d28088d3b0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Image pref 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 18:46:56.868386 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-853fb00d-798a-49f0-902d-89d28088d3b0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 18:46:56.877690 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-853fb00d-798a-49f0-902d-89d28088d3b0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:56.877983 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-853fb00d-798a-49f0-902d-89d28088d3b0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:56.878816 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-853fb00d-798a-49f0-902d-89d28088d3b0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:56.879251 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-853fb00d-798a-49f0-902d-89d28088d3b0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:56.896312 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-853fb00d-798a-49f0-902d-89d28088d3b0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Getting quotas for project e03ab1e3fbe7445da087c631d8af557b. Resources: {'ram', 'cores', 'instances'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:46:56.900318 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-853fb00d-798a-49f0-902d-89d28088d3b0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Getting quotas for user 78b6599200a94a2a8bcc0149dc22944d and project e03ab1e3fbe7445da087c631d8af557b. Resources: {'ram', 'cores', 'instances'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:46:56.912152 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-853fb00d-798a-49f0-902d-89d28088d3b0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Going to run 1 instances... {{(pid=124717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 18:46:56.915171 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-853fb00d-798a-49f0-902d-89d28088d3b0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 18:46:57.038774 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-853fb00d-798a-49f0-902d-89d28088d3b0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.741773 Jun 27 18:46:57.039412 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 92/192] 10.222.0.15 () {60 vars in 1146 bytes} [Mon Jun 27 18:46:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 18:46:57.049169 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-c5a32c5c-7bee-49ed-a375-b5bf4fb86372 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:57.049773 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-c5a32c5c-7bee-49ed-a375-b5bf4fb86372 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:57.145078 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c5a32c5c-7bee-49ed-a375-b5bf4fb86372 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:57.154058 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-c5a32c5c-7bee-49ed-a375-b5bf4fb86372 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1222 microversion: 2.1 time: 0.107764 Jun 27 18:46:57.155125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 101/193] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:57 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:57.297477 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-39d72dd8-498d-4360-96da-e5125cbe2aff tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-406839003", "imageRef": "c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:46:57.353156 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.network.neutron [None req-39d72dd8-498d-4360-96da-e5125cbe2aff tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] validate_networks() for [('2f67bf90-aaaf-40ed-b8c3-5bdd36fb3e3d', None, None, None, None, None)] {{(pid=124717) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 18:46:57.767673 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-39d72dd8-498d-4360-96da-e5125cbe2aff tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Flavor limits 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 18:46:57.768105 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-39d72dd8-498d-4360-96da-e5125cbe2aff tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Image limits 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 18:46:57.768586 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-39d72dd8-498d-4360-96da-e5125cbe2aff tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Flavor pref 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 18:46:57.769005 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-39d72dd8-498d-4360-96da-e5125cbe2aff tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Image pref 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 18:46:57.769426 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-39d72dd8-498d-4360-96da-e5125cbe2aff tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 18:46:57.801085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-39d72dd8-498d-4360-96da-e5125cbe2aff tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:57.801579 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-39d72dd8-498d-4360-96da-e5125cbe2aff tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:57.802408 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-39d72dd8-498d-4360-96da-e5125cbe2aff tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:57.803643 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-39d72dd8-498d-4360-96da-e5125cbe2aff tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:57.828187 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-39d72dd8-498d-4360-96da-e5125cbe2aff tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Getting quotas for project e03ab1e3fbe7445da087c631d8af557b. Resources: {'ram', 'cores', 'instances'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:46:57.832026 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-39d72dd8-498d-4360-96da-e5125cbe2aff tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Getting quotas for user 78b6599200a94a2a8bcc0149dc22944d and project e03ab1e3fbe7445da087c631d8af557b. Resources: {'ram', 'cores', 'instances'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:46:57.843136 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-39d72dd8-498d-4360-96da-e5125cbe2aff tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Going to run 1 instances... {{(pid=124717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 18:46:57.845259 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-39d72dd8-498d-4360-96da-e5125cbe2aff tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 18:46:57.874406 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-0440b6bc-4520-44cc-8906-3126c3484dc6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:46:57.877494 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-0440b6bc-4520-44cc-8906-3126c3484dc6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:57.884292 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0440b6bc-4520-44cc-8906-3126c3484dc6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:57.884747 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0440b6bc-4520-44cc-8906-3126c3484dc6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:57.885665 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0440b6bc-4520-44cc-8906-3126c3484dc6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:57.886171 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0440b6bc-4520-44cc-8906-3126c3484dc6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:57.945999 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.objects.instance [None req-0440b6bc-4520-44cc-8906-3126c3484dc6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lazy-loading 'flavor' on Instance uuid 91366512-6fa4-4a20-a867-94852749b02f {{(pid=124716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:46:58.031898 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-39d72dd8-498d-4360-96da-e5125cbe2aff tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.739092 Jun 27 18:46:58.032565 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 93/194] 10.222.0.15 () {60 vars in 1146 bytes} [Mon Jun 27 18:46:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 18:46:58.044547 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-d699a70e-cfa2-4190-80c0-9cbc8d216702 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:58.046722 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-d699a70e-cfa2-4190-80c0-9cbc8d216702 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:58.128002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-d699a70e-cfa2-4190-80c0-9cbc8d216702 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:58.135545 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-d699a70e-cfa2-4190-80c0-9cbc8d216702 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1221 microversion: 2.1 time: 0.095692 Jun 27 18:46:58.145296 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 94/195] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:58 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1221 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:46:58.797607 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-0440b6bc-4520-44cc-8906-3126c3484dc6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "POST /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f/action" status: 202 len: 0 microversion: 2.20 time: 0.925416 Jun 27 18:46:58.804580 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 102/196] 10.222.0.15 () {62 vars in 1318 bytes} [Mon Jun 27 18:46:57 2022] POST /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f/action => generated 0 bytes in 934 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 18:46:58.809410 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-75a839c3-2ce9-457d-94b4-8acf3506fffe tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:58.811118 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-75a839c3-2ce9-457d-94b4-8acf3506fffe tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:58.839525 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-75a839c3-2ce9-457d-94b4-8acf3506fffe tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:58.843918 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-75a839c3-2ce9-457d-94b4-8acf3506fffe tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:58.844813 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-75a839c3-2ce9-457d-94b4-8acf3506fffe tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:58.846290 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-75a839c3-2ce9-457d-94b4-8acf3506fffe tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:59.075077 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-75a839c3-2ce9-457d-94b4-8acf3506fffe tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:59.093349 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-75a839c3-2ce9-457d-94b4-8acf3506fffe tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:59.095050 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-75a839c3-2ce9-457d-94b4-8acf3506fffe tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:59.103272 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-75a839c3-2ce9-457d-94b4-8acf3506fffe tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1723 microversion: 2.20 time: 0.293423 Jun 27 18:46:59.103272 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 95/197] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:46:58 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:46:59.159487 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a0a3de03-1c10-465c-bef0-2989354f78fd tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:46:59.166682 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a0a3de03-1c10-465c-bef0-2989354f78fd tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:46:59.171452 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a0a3de03-1c10-465c-bef0-2989354f78fd tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:59.171922 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a0a3de03-1c10-465c-bef0-2989354f78fd tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:59.172715 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a0a3de03-1c10-465c-bef0-2989354f78fd tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:46:59.173285 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a0a3de03-1c10-465c-bef0-2989354f78fd tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:46:59.319209 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a0a3de03-1c10-465c-bef0-2989354f78fd tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:46:59.328156 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a0a3de03-1c10-465c-bef0-2989354f78fd tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1225 microversion: 2.1 time: 0.176225 Jun 27 18:46:59.328777 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 103/198] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:46:59 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1225 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:00.117560 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-51225484-674c-4928-b5e6-8d6f3e9507cd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:00.118303 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-51225484-674c-4928-b5e6-8d6f3e9507cd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:00.126992 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-51225484-674c-4928-b5e6-8d6f3e9507cd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:00.127754 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-51225484-674c-4928-b5e6-8d6f3e9507cd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:00.137825 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-51225484-674c-4928-b5e6-8d6f3e9507cd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:00.137825 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-51225484-674c-4928-b5e6-8d6f3e9507cd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:00.293115 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-51225484-674c-4928-b5e6-8d6f3e9507cd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:00.305706 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-51225484-674c-4928-b5e6-8d6f3e9507cd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:00.307899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-51225484-674c-4928-b5e6-8d6f3e9507cd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:00.309722 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-51225484-674c-4928-b5e6-8d6f3e9507cd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1723 microversion: 2.20 time: 0.195944 Jun 27 18:47:00.309722 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 96/199] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:00 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:00.345565 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-e56208c5-7653-4a53-afb4-cf88e0675074 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:00.346185 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-e56208c5-7653-4a53-afb4-cf88e0675074 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:00.369937 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e56208c5-7653-4a53-afb4-cf88e0675074 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:00.370541 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e56208c5-7653-4a53-afb4-cf88e0675074 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:00.371371 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e56208c5-7653-4a53-afb4-cf88e0675074 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:00.371805 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e56208c5-7653-4a53-afb4-cf88e0675074 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:00.488674 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-e56208c5-7653-4a53-afb4-cf88e0675074 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:00.497212 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-e56208c5-7653-4a53-afb4-cf88e0675074 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1273 microversion: 2.1 time: 0.155875 Jun 27 18:47:00.497791 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 104/200] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:00 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1273 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:00.806476 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-5ffa45a8-3a19-404f-9f15-c638e474764e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:00.807050 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-5ffa45a8-3a19-404f-9f15-c638e474764e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:00.814266 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5ffa45a8-3a19-404f-9f15-c638e474764e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:00.815009 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5ffa45a8-3a19-404f-9f15-c638e474764e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:00.817447 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5ffa45a8-3a19-404f-9f15-c638e474764e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:00.818083 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5ffa45a8-3a19-404f-9f15-c638e474764e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:00.843012 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-5ffa45a8-3a19-404f-9f15-c638e474764e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91/ips" status: 200 len: 145 microversion: 2.1 time: 0.045670 Jun 27 18:47:00.843592 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 97/201] 10.222.0.15 () {58 vars in 1247 bytes} [Mon Jun 27 18:47:00 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91/ips => generated 145 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:47:01.327668 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f4072aba-bd9c-4062-ac89-331a5070db3d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:01.328516 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f4072aba-bd9c-4062-ac89-331a5070db3d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:01.334836 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f4072aba-bd9c-4062-ac89-331a5070db3d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:01.335284 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f4072aba-bd9c-4062-ac89-331a5070db3d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:01.336618 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f4072aba-bd9c-4062-ac89-331a5070db3d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:01.336618 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f4072aba-bd9c-4062-ac89-331a5070db3d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:01.469855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f4072aba-bd9c-4062-ac89-331a5070db3d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:01.478350 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f4072aba-bd9c-4062-ac89-331a5070db3d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:01.480424 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f4072aba-bd9c-4062-ac89-331a5070db3d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:01.482924 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f4072aba-bd9c-4062-ac89-331a5070db3d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1723 microversion: 2.20 time: 0.159348 Jun 27 18:47:01.483865 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 105/202] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:01 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:01.519838 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-78557d02-8cda-471c-83a9-d632c8a72a7a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:01.519838 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-78557d02-8cda-471c-83a9-d632c8a72a7a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:01.523244 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-78557d02-8cda-471c-83a9-d632c8a72a7a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:01.523944 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-78557d02-8cda-471c-83a9-d632c8a72a7a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:01.525163 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-78557d02-8cda-471c-83a9-d632c8a72a7a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:01.525827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-78557d02-8cda-471c-83a9-d632c8a72a7a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:01.726565 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-78557d02-8cda-471c-83a9-d632c8a72a7a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:01.748109 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-78557d02-8cda-471c-83a9-d632c8a72a7a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1321 microversion: 2.1 time: 0.237585 Jun 27 18:47:01.748907 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 98/203] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:01 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:02.219559 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-22d88033-f704-4aa1-a864-2a5b08c7323e req-4046e97f-afac-4e6d-8cd5-9f29db717161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "657439fb-0239-40b2-9be0-56c5b7dc558c", "tag": "3ed5d7ea-357c-46c3-8977-0d7855beac6c"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:47:02.243170 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-22d88033-f704-4aa1-a864-2a5b08c7323e req-4046e97f-afac-4e6d-8cd5-9f29db717161 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:02.243867 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-22d88033-f704-4aa1-a864-2a5b08c7323e req-4046e97f-afac-4e6d-8cd5-9f29db717161 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:02.255795 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-22d88033-f704-4aa1-a864-2a5b08c7323e req-4046e97f-afac-4e6d-8cd5-9f29db717161 service nova] Creating event network-changed:3ed5d7ea-357c-46c3-8977-0d7855beac6c for instance 657439fb-0239-40b2-9be0-56c5b7dc558c on hv-cinder-84460 Jun 27 18:47:02.261548 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-22d88033-f704-4aa1-a864-2a5b08c7323e req-4046e97f-afac-4e6d-8cd5-9f29db717161 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052599 Jun 27 18:47:02.262147 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 106/204] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:47:02.501720 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-afa405f2-9bba-422e-a333-98c9c4e5c097 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:02.502279 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-afa405f2-9bba-422e-a333-98c9c4e5c097 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:02.508554 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-afa405f2-9bba-422e-a333-98c9c4e5c097 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:02.509009 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-afa405f2-9bba-422e-a333-98c9c4e5c097 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:02.509826 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-afa405f2-9bba-422e-a333-98c9c4e5c097 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:02.510624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-afa405f2-9bba-422e-a333-98c9c4e5c097 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:02.657957 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-afa405f2-9bba-422e-a333-98c9c4e5c097 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:02.668515 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-afa405f2-9bba-422e-a333-98c9c4e5c097 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:02.670187 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-afa405f2-9bba-422e-a333-98c9c4e5c097 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:02.671575 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-afa405f2-9bba-422e-a333-98c9c4e5c097 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1723 microversion: 2.20 time: 0.173701 Jun 27 18:47:02.682423 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 99/205] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:02 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:02.766131 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-205c0b7b-fa13-4fc8-85bb-12544a916c0e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:02.767004 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-205c0b7b-fa13-4fc8-85bb-12544a916c0e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:02.775543 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-205c0b7b-fa13-4fc8-85bb-12544a916c0e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:02.776078 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-205c0b7b-fa13-4fc8-85bb-12544a916c0e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:02.776917 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-205c0b7b-fa13-4fc8-85bb-12544a916c0e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:02.777572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-205c0b7b-fa13-4fc8-85bb-12544a916c0e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:02.962256 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-205c0b7b-fa13-4fc8-85bb-12544a916c0e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:02.969758 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-205c0b7b-fa13-4fc8-85bb-12544a916c0e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1321 microversion: 2.1 time: 0.208350 Jun 27 18:47:02.970659 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 107/206] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:02 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:03.690996 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0f4b6dba-b129-4a1c-b731-5ff47285106d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:03.691605 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-0f4b6dba-b129-4a1c-b731-5ff47285106d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:03.698462 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0f4b6dba-b129-4a1c-b731-5ff47285106d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:03.698909 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0f4b6dba-b129-4a1c-b731-5ff47285106d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:03.699656 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0f4b6dba-b129-4a1c-b731-5ff47285106d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:03.700081 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0f4b6dba-b129-4a1c-b731-5ff47285106d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:03.987911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-0b86904e-2b25-403e-9c89-e37ae75d8a40 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:03.988672 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-0b86904e-2b25-403e-9c89-e37ae75d8a40 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:03.995361 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0b86904e-2b25-403e-9c89-e37ae75d8a40 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:03.996087 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0b86904e-2b25-403e-9c89-e37ae75d8a40 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:03.996926 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0b86904e-2b25-403e-9c89-e37ae75d8a40 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:03.997523 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0b86904e-2b25-403e-9c89-e37ae75d8a40 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:04.027516 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-0f4b6dba-b129-4a1c-b731-5ff47285106d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:04.035965 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-0f4b6dba-b129-4a1c-b731-5ff47285106d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:04.037753 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-0f4b6dba-b129-4a1c-b731-5ff47285106d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:04.038954 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-0f4b6dba-b129-4a1c-b731-5ff47285106d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1723 microversion: 2.20 time: 0.351839 Jun 27 18:47:04.039510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 100/207] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:03 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1723 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:04.167034 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-0b86904e-2b25-403e-9c89-e37ae75d8a40 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:04.175049 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-0b86904e-2b25-403e-9c89-e37ae75d8a40 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1321 microversion: 2.1 time: 0.190791 Jun 27 18:47:04.175997 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 108/208] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:03 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:04.837002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-d76f7292-7134-4260-9974-69246f26d306 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de74325f-36c3-4822-aaf8-75c7ab3b5f59"}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:47:04.838840 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-d76f7292-7134-4260-9974-69246f26d306 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:04.847959 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d76f7292-7134-4260-9974-69246f26d306 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:04.848598 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d76f7292-7134-4260-9974-69246f26d306 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:04.849535 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d76f7292-7134-4260-9974-69246f26d306 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:04.850043 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d76f7292-7134-4260-9974-69246f26d306 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:05.053197 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-88f75db7-1bb6-49d4-935d-b9d9e4473d92 req-c9c18d00-c6c5-4700-9e2f-94a63d430c85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b43630d1-a618-48b7-9837-b88b6f99fe34", "tag": "0b1ffb29-dfee-404e-889b-5d32165b9788"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:47:05.082635 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-88f75db7-1bb6-49d4-935d-b9d9e4473d92 req-c9c18d00-c6c5-4700-9e2f-94a63d430c85 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:05.084395 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-88f75db7-1bb6-49d4-935d-b9d9e4473d92 req-c9c18d00-c6c5-4700-9e2f-94a63d430c85 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:05.118791 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-88f75db7-1bb6-49d4-935d-b9d9e4473d92 req-c9c18d00-c6c5-4700-9e2f-94a63d430c85 service nova] Creating event network-changed:0b1ffb29-dfee-404e-889b-5d32165b9788 for instance b43630d1-a618-48b7-9837-b88b6f99fe34 on hv-cinder-84460 Jun 27 18:47:05.127452 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-88f75db7-1bb6-49d4-935d-b9d9e4473d92 req-c9c18d00-c6c5-4700-9e2f-94a63d430c85 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079432 Jun 27 18:47:05.129977 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 109/209] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:47:05.137878 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-fcd91c43-2c81-421a-8277-8e0586005724 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:05.139941 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-fcd91c43-2c81-421a-8277-8e0586005724 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:05.151036 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fcd91c43-2c81-421a-8277-8e0586005724 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:05.151622 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fcd91c43-2c81-421a-8277-8e0586005724 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:05.153346 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fcd91c43-2c81-421a-8277-8e0586005724 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:05.154025 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fcd91c43-2c81-421a-8277-8e0586005724 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:05.326572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-fcd91c43-2c81-421a-8277-8e0586005724 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:05.335648 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-fcd91c43-2c81-421a-8277-8e0586005724 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:05.337687 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-fcd91c43-2c81-421a-8277-8e0586005724 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:05.339127 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-fcd91c43-2c81-421a-8277-8e0586005724 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1723 microversion: 2.20 time: 0.207537 Jun 27 18:47:05.339837 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 110/210] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:05 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:05.345320 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-94ca7e2a-2c8a-4df2-9f00-cb842e6384b4 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:05.346271 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-94ca7e2a-2c8a-4df2-9f00-cb842e6384b4 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:05.355091 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-94ca7e2a-2c8a-4df2-9f00-cb842e6384b4 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:05.355794 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-94ca7e2a-2c8a-4df2-9f00-cb842e6384b4 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:05.356572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-94ca7e2a-2c8a-4df2-9f00-cb842e6384b4 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:05.357041 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-94ca7e2a-2c8a-4df2-9f00-cb842e6384b4 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:05.540807 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-94ca7e2a-2c8a-4df2-9f00-cb842e6384b4 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:05.548222 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-94ca7e2a-2c8a-4df2-9f00-cb842e6384b4 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1321 microversion: 2.1 time: 0.207262 Jun 27 18:47:05.548787 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 111/211] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:05 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:06.360182 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-13aef99e-dbab-40a7-95c8-82c820fb92d0 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:06.360841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-13aef99e-dbab-40a7-95c8-82c820fb92d0 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:06.367845 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-13aef99e-dbab-40a7-95c8-82c820fb92d0 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:06.368594 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-13aef99e-dbab-40a7-95c8-82c820fb92d0 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:06.369375 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-13aef99e-dbab-40a7-95c8-82c820fb92d0 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:06.369813 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-13aef99e-dbab-40a7-95c8-82c820fb92d0 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:06.510531 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-13aef99e-dbab-40a7-95c8-82c820fb92d0 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:06.518337 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-13aef99e-dbab-40a7-95c8-82c820fb92d0 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:06.519953 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-13aef99e-dbab-40a7-95c8-82c820fb92d0 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:06.521158 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-13aef99e-dbab-40a7-95c8-82c820fb92d0 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1723 microversion: 2.20 time: 0.164963 Jun 27 18:47:06.521723 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 112/212] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:06 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:47:06.564394 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f930b8c7-cdf2-43b7-9568-7df33748256c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:06.565009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f930b8c7-cdf2-43b7-9568-7df33748256c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:06.572943 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f930b8c7-cdf2-43b7-9568-7df33748256c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:06.573399 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f930b8c7-cdf2-43b7-9568-7df33748256c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:06.574173 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f930b8c7-cdf2-43b7-9568-7df33748256c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:06.574641 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f930b8c7-cdf2-43b7-9568-7df33748256c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:06.666217 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-d76f7292-7134-4260-9974-69246f26d306 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "POST /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.833210 Jun 27 18:47:06.667816 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 101/213] 10.222.0.15 () {60 vars in 1322 bytes} [Mon Jun 27 18:47:04 2022] POST /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91/os-volume_attachments => generated 194 bytes in 1835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:47:06.718043 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f930b8c7-cdf2-43b7-9568-7df33748256c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:06.727246 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f930b8c7-cdf2-43b7-9568-7df33748256c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1321 microversion: 2.1 time: 0.167064 Jun 27 18:47:06.727825 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 113/214] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:06 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:07.540811 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-140391bf-0a4f-4507-9131-d8710883cc6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:07.541617 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-140391bf-0a4f-4507-9131-d8710883cc6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:07.547898 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-140391bf-0a4f-4507-9131-d8710883cc6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:07.548353 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-140391bf-0a4f-4507-9131-d8710883cc6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:07.549733 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-140391bf-0a4f-4507-9131-d8710883cc6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:07.549733 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-140391bf-0a4f-4507-9131-d8710883cc6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:07.745696 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7323cd79-5a14-46df-97c8-8ef5afabc48f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:07.746577 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-7323cd79-5a14-46df-97c8-8ef5afabc48f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:07.747053 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-140391bf-0a4f-4507-9131-d8710883cc6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:07.748782 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=2 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:47:07.753760 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7323cd79-5a14-46df-97c8-8ef5afabc48f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:07.754206 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7323cd79-5a14-46df-97c8-8ef5afabc48f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:07.755026 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7323cd79-5a14-46df-97c8-8ef5afabc48f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:07.755551 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7323cd79-5a14-46df-97c8-8ef5afabc48f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:07.757855 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-140391bf-0a4f-4507-9131-d8710883cc6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:07.759559 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-140391bf-0a4f-4507-9131-d8710883cc6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:07.760995 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-140391bf-0a4f-4507-9131-d8710883cc6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1723 microversion: 2.20 time: 0.225234 Jun 27 18:47:07.763309 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 102/215] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:07 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:07.888421 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-7323cd79-5a14-46df-97c8-8ef5afabc48f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:07.896479 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-7323cd79-5a14-46df-97c8-8ef5afabc48f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1321 microversion: 2.1 time: 0.154495 Jun 27 18:47:07.901543 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 114/216] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:07 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:08.780343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-ab4758de-8228-4113-b921-4361da1a2d7c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:08.781010 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-ab4758de-8228-4113-b921-4361da1a2d7c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:08.782976 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell0:SELECT=4 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:47:08.783655 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell0:SELECT=14 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:47:08.789446 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ab4758de-8228-4113-b921-4361da1a2d7c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:08.789446 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ab4758de-8228-4113-b921-4361da1a2d7c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:08.791214 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ab4758de-8228-4113-b921-4361da1a2d7c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:08.792291 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ab4758de-8228-4113-b921-4361da1a2d7c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:08.914719 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f78e6b3a-07e0-401f-a871-b4eefd020879 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:08.917763 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f78e6b3a-07e0-401f-a871-b4eefd020879 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:08.924436 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f78e6b3a-07e0-401f-a871-b4eefd020879 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:08.925095 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f78e6b3a-07e0-401f-a871-b4eefd020879 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:08.925897 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f78e6b3a-07e0-401f-a871-b4eefd020879 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:08.926514 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f78e6b3a-07e0-401f-a871-b4eefd020879 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:08.948036 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-ab4758de-8228-4113-b921-4361da1a2d7c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:08.976144 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-ab4758de-8228-4113-b921-4361da1a2d7c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:08.977668 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-ab4758de-8228-4113-b921-4361da1a2d7c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:08.978930 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-ab4758de-8228-4113-b921-4361da1a2d7c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1723 microversion: 2.20 time: 0.202466 Jun 27 18:47:08.979485 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 103/217] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:08 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:09.074264 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f78e6b3a-07e0-401f-a871-b4eefd020879 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:09.081828 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f78e6b3a-07e0-401f-a871-b4eefd020879 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1321 microversion: 2.1 time: 0.172176 Jun 27 18:47:09.082852 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 115/218] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:08 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:10.000512 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-57fc8abd-fcc5-4ecc-abf6-fff7916d08ac tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:10.001047 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-57fc8abd-fcc5-4ecc-abf6-fff7916d08ac tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:10.008703 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-57fc8abd-fcc5-4ecc-abf6-fff7916d08ac tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:10.009196 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-57fc8abd-fcc5-4ecc-abf6-fff7916d08ac tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:10.009956 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-57fc8abd-fcc5-4ecc-abf6-fff7916d08ac tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:10.010408 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-57fc8abd-fcc5-4ecc-abf6-fff7916d08ac tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:10.099716 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-140cd119-fa96-48ad-b31b-d9b58423949b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:10.101682 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-140cd119-fa96-48ad-b31b-d9b58423949b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:10.108226 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-140cd119-fa96-48ad-b31b-d9b58423949b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:10.108683 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-140cd119-fa96-48ad-b31b-d9b58423949b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:10.109643 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-140cd119-fa96-48ad-b31b-d9b58423949b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:10.110251 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-140cd119-fa96-48ad-b31b-d9b58423949b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:10.147545 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-57fc8abd-fcc5-4ecc-abf6-fff7916d08ac tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:10.160676 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-57fc8abd-fcc5-4ecc-abf6-fff7916d08ac tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:10.165075 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-57fc8abd-fcc5-4ecc-abf6-fff7916d08ac tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:10.165075 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-57fc8abd-fcc5-4ecc-abf6-fff7916d08ac tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1744 microversion: 2.20 time: 0.168086 Jun 27 18:47:10.165969 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 104/219] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:09 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:10.274005 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-140cd119-fa96-48ad-b31b-d9b58423949b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:10.281822 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-140cd119-fa96-48ad-b31b-d9b58423949b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1321 microversion: 2.1 time: 0.186754 Jun 27 18:47:10.282451 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 116/220] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:10 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:10.481298 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-d78964ed-74c4-4119-bf7f-af67afd5afd5 req-4d95e024-f909-4c47-952e-5ce212586116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "657439fb-0239-40b2-9be0-56c5b7dc558c", "name": "network-vif-plugged", "status": "completed", "tag": "3ed5d7ea-357c-46c3-8977-0d7855beac6c"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:47:10.492710 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-d78964ed-74c4-4119-bf7f-af67afd5afd5 req-4d95e024-f909-4c47-952e-5ce212586116 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:10.493160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-d78964ed-74c4-4119-bf7f-af67afd5afd5 req-4d95e024-f909-4c47-952e-5ce212586116 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:10.506514 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-d78964ed-74c4-4119-bf7f-af67afd5afd5 req-4d95e024-f909-4c47-952e-5ce212586116 service nova] Creating event network-vif-plugged:3ed5d7ea-357c-46c3-8977-0d7855beac6c for instance 657439fb-0239-40b2-9be0-56c5b7dc558c on hv-cinder-84460 Jun 27 18:47:10.513956 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-d78964ed-74c4-4119-bf7f-af67afd5afd5 req-4d95e024-f909-4c47-952e-5ce212586116 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036703 Jun 27 18:47:10.515028 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 105/221] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:47:11.184347 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7fe0f3a3-43b5-4a1e-8526-9b031bd9f98a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:11.185027 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-7fe0f3a3-43b5-4a1e-8526-9b031bd9f98a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:11.191131 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7fe0f3a3-43b5-4a1e-8526-9b031bd9f98a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:11.191580 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7fe0f3a3-43b5-4a1e-8526-9b031bd9f98a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:11.192342 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7fe0f3a3-43b5-4a1e-8526-9b031bd9f98a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:11.193409 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7fe0f3a3-43b5-4a1e-8526-9b031bd9f98a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:11.197785 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:47:11.299693 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-3b1e16d5-9535-4437-b1a6-5ce479f0bd15 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:11.300395 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-3b1e16d5-9535-4437-b1a6-5ce479f0bd15 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:11.307348 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3b1e16d5-9535-4437-b1a6-5ce479f0bd15 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:11.308101 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3b1e16d5-9535-4437-b1a6-5ce479f0bd15 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:11.309065 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3b1e16d5-9535-4437-b1a6-5ce479f0bd15 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:11.309505 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3b1e16d5-9535-4437-b1a6-5ce479f0bd15 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:11.342594 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-7fe0f3a3-43b5-4a1e-8526-9b031bd9f98a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:11.350934 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-7fe0f3a3-43b5-4a1e-8526-9b031bd9f98a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:11.352745 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-7fe0f3a3-43b5-4a1e-8526-9b031bd9f98a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:11.353935 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-7fe0f3a3-43b5-4a1e-8526-9b031bd9f98a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1744 microversion: 2.20 time: 0.173738 Jun 27 18:47:11.354522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 117/222] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:11 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:11.454274 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-3b1e16d5-9535-4437-b1a6-5ce479f0bd15 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:11.463012 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-3b1e16d5-9535-4437-b1a6-5ce479f0bd15 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1321 microversion: 2.1 time: 0.167435 Jun 27 18:47:11.463760 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 106/223] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:11 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:12.375029 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f75728b0-e5db-4d5a-abdf-5e676ea2485a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:12.375987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f75728b0-e5db-4d5a-abdf-5e676ea2485a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:12.384899 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f75728b0-e5db-4d5a-abdf-5e676ea2485a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:12.385489 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f75728b0-e5db-4d5a-abdf-5e676ea2485a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:12.390205 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f75728b0-e5db-4d5a-abdf-5e676ea2485a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:12.391157 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f75728b0-e5db-4d5a-abdf-5e676ea2485a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:12.481372 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-7c75768a-1e10-4693-afce-3f12664d3691 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:12.482359 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-7c75768a-1e10-4693-afce-3f12664d3691 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:12.495750 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7c75768a-1e10-4693-afce-3f12664d3691 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:12.496846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7c75768a-1e10-4693-afce-3f12664d3691 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:12.499062 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7c75768a-1e10-4693-afce-3f12664d3691 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:12.499980 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7c75768a-1e10-4693-afce-3f12664d3691 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:13.188696 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f75728b0-e5db-4d5a-abdf-5e676ea2485a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:13.199008 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f75728b0-e5db-4d5a-abdf-5e676ea2485a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:13.199998 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-7c75768a-1e10-4693-afce-3f12664d3691 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:13.201019 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f75728b0-e5db-4d5a-abdf-5e676ea2485a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:13.202298 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f75728b0-e5db-4d5a-abdf-5e676ea2485a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1739 microversion: 2.20 time: 0.832895 Jun 27 18:47:13.203067 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 118/224] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:12 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1739 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:47:13.208526 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-43ddf319-fcc8-4fb7-8961-ed55acb19725 req-0965552b-29dd-47c8-97ac-965938c265d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b43630d1-a618-48b7-9837-b88b6f99fe34", "name": "network-vif-plugged", "status": "completed", "tag": "0b1ffb29-dfee-404e-889b-5d32165b9788"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:47:13.217816 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-43ddf319-fcc8-4fb7-8961-ed55acb19725 req-0965552b-29dd-47c8-97ac-965938c265d4 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:13.218587 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-43ddf319-fcc8-4fb7-8961-ed55acb19725 req-0965552b-29dd-47c8-97ac-965938c265d4 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:13.221124 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-7c75768a-1e10-4693-afce-3f12664d3691 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1321 microversion: 2.1 time: 0.744003 Jun 27 18:47:13.221716 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 107/225] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:12 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1321 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:13.244300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-43ddf319-fcc8-4fb7-8961-ed55acb19725 req-0965552b-29dd-47c8-97ac-965938c265d4 service nova] Creating event network-vif-plugged:0b1ffb29-dfee-404e-889b-5d32165b9788 for instance b43630d1-a618-48b7-9837-b88b6f99fe34 on hv-cinder-84460 Jun 27 18:47:13.253553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-43ddf319-fcc8-4fb7-8961-ed55acb19725 req-0965552b-29dd-47c8-97ac-965938c265d4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048942 Jun 27 18:47:13.254229 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 119/226] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:47:14.227239 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-8af86d1f-e3e4-493a-951f-0e18f1e1ab5c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:14.249355 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-8af86d1f-e3e4-493a-951f-0e18f1e1ab5c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:14.250126 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-c46d9735-cf0a-49ab-b5fe-cee38404ec1a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:14.250126 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-c46d9735-cf0a-49ab-b5fe-cee38404ec1a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:14.262564 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c46d9735-cf0a-49ab-b5fe-cee38404ec1a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:14.282038 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8af86d1f-e3e4-493a-951f-0e18f1e1ab5c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:14.282540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8af86d1f-e3e4-493a-951f-0e18f1e1ab5c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:14.283389 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8af86d1f-e3e4-493a-951f-0e18f1e1ab5c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:14.283832 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8af86d1f-e3e4-493a-951f-0e18f1e1ab5c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:14.288822 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c46d9735-cf0a-49ab-b5fe-cee38404ec1a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:14.289831 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c46d9735-cf0a-49ab-b5fe-cee38404ec1a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:14.290277 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c46d9735-cf0a-49ab-b5fe-cee38404ec1a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:14.775513 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c46d9735-cf0a-49ab-b5fe-cee38404ec1a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:14.789744 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-c46d9735-cf0a-49ab-b5fe-cee38404ec1a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1321 microversion: 2.1 time: 0.554275 Jun 27 18:47:14.790694 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 120/227] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:14 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1321 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:14.794506 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-8af86d1f-e3e4-493a-951f-0e18f1e1ab5c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:14.804232 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-8af86d1f-e3e4-493a-951f-0e18f1e1ab5c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:14.805756 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-8af86d1f-e3e4-493a-951f-0e18f1e1ab5c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:14.807092 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-8af86d1f-e3e4-493a-951f-0e18f1e1ab5c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1739 microversion: 2.20 time: 0.584465 Jun 27 18:47:14.807646 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 108/228] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:14 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1739 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:15.273957 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-947e9c8c-9536-4b9d-86ef-a4ab71d9b58a req-c579f390-f7ab-4e37-8aa8-2cf39adb4502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91366512-6fa4-4a20-a867-94852749b02f", "name": "network-vif-plugged", "status": "completed", "tag": "3ca020b2-805d-45e4-9147-1a3d32b54834"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:47:15.285437 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-947e9c8c-9536-4b9d-86ef-a4ab71d9b58a req-c579f390-f7ab-4e37-8aa8-2cf39adb4502 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:15.285437 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-947e9c8c-9536-4b9d-86ef-a4ab71d9b58a req-c579f390-f7ab-4e37-8aa8-2cf39adb4502 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:15.310802 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-947e9c8c-9536-4b9d-86ef-a4ab71d9b58a req-c579f390-f7ab-4e37-8aa8-2cf39adb4502 service nova] Creating event network-vif-plugged:3ca020b2-805d-45e4-9147-1a3d32b54834 for instance 91366512-6fa4-4a20-a867-94852749b02f on hv-cinder-84460 Jun 27 18:47:15.313240 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-947e9c8c-9536-4b9d-86ef-a4ab71d9b58a req-c579f390-f7ab-4e37-8aa8-2cf39adb4502 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043966 Jun 27 18:47:15.318716 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 121/229] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:47:15.808779 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-64f52cff-41da-436b-82ca-191d563e3bd8 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:15.810179 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-64f52cff-41da-436b-82ca-191d563e3bd8 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:15.823192 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-64f52cff-41da-436b-82ca-191d563e3bd8 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:15.834118 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-3e7a5b27-3c48-403d-8e8c-07b46e9ef62b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:15.834118 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-3e7a5b27-3c48-403d-8e8c-07b46e9ef62b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:15.838947 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-64f52cff-41da-436b-82ca-191d563e3bd8 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:15.839825 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-64f52cff-41da-436b-82ca-191d563e3bd8 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:15.843754 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-64f52cff-41da-436b-82ca-191d563e3bd8 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:15.862826 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3e7a5b27-3c48-403d-8e8c-07b46e9ef62b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:15.862826 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3e7a5b27-3c48-403d-8e8c-07b46e9ef62b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:15.862826 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3e7a5b27-3c48-403d-8e8c-07b46e9ef62b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:15.862826 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3e7a5b27-3c48-403d-8e8c-07b46e9ef62b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:16.135563 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-64f52cff-41da-436b-82ca-191d563e3bd8 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:16.156995 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-64f52cff-41da-436b-82ca-191d563e3bd8 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1321 microversion: 2.1 time: 0.353740 Jun 27 18:47:16.162513 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 109/230] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:15 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1321 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:16.173378 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3e7a5b27-3c48-403d-8e8c-07b46e9ef62b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:16.190459 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3e7a5b27-3c48-403d-8e8c-07b46e9ef62b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:16.192517 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3e7a5b27-3c48-403d-8e8c-07b46e9ef62b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:16.205936 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-3e7a5b27-3c48-403d-8e8c-07b46e9ef62b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1739 microversion: 2.20 time: 0.382425 Jun 27 18:47:16.208049 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 122/231] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:15 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1739 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:16.767624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-b6bf6073-3962-4e1f-ba7a-0c8b73ae185a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:47:16.771530 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b6bf6073-3962-4e1f-ba7a-0c8b73ae185a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:16.771530 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b6bf6073-3962-4e1f-ba7a-0c8b73ae185a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:16.851241 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:47:16.851241 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-b6bf6073-3962-4e1f-ba7a-0c8b73ae185a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Going to try to stop instance {{(pid=124717) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 27 18:47:17.180914 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-c5435773-41eb-4a41-b519-acee759dd0e5 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:17.181484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-c5435773-41eb-4a41-b519-acee759dd0e5 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:17.187839 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c5435773-41eb-4a41-b519-acee759dd0e5 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:17.188292 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c5435773-41eb-4a41-b519-acee759dd0e5 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:17.189047 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c5435773-41eb-4a41-b519-acee759dd0e5 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:17.189569 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c5435773-41eb-4a41-b519-acee759dd0e5 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:17.345765 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-b6bf6073-3962-4e1f-ba7a-0c8b73ae185a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "POST /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91/action" status: 202 len: 0 microversion: 2.1 time: 0.594642 Jun 27 18:47:17.347398 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 110/232] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Jun 27 18:47:16 2022] POST /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:47:17.355507 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-6e089353-167e-4b56-ad1b-2d8085d44a32 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:17.356609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-6e089353-167e-4b56-ad1b-2d8085d44a32 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:17.372720 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6e089353-167e-4b56-ad1b-2d8085d44a32 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:17.373528 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6e089353-167e-4b56-ad1b-2d8085d44a32 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:17.374541 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6e089353-167e-4b56-ad1b-2d8085d44a32 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:17.375110 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6e089353-167e-4b56-ad1b-2d8085d44a32 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:17.377225 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c5435773-41eb-4a41-b519-acee759dd0e5 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:17.389552 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-c5435773-41eb-4a41-b519-acee759dd0e5 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1515 microversion: 2.1 time: 0.213339 Jun 27 18:47:17.390139 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 123/233] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:17 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1515 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:17.398460 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-fafa9c7a-a1d9-4f0a-869f-1e35dc6ca82a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:17.405437 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-fafa9c7a-a1d9-4f0a-869f-1e35dc6ca82a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:17.413395 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fafa9c7a-a1d9-4f0a-869f-1e35dc6ca82a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:17.413856 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fafa9c7a-a1d9-4f0a-869f-1e35dc6ca82a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:17.414668 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fafa9c7a-a1d9-4f0a-869f-1e35dc6ca82a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:17.415225 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fafa9c7a-a1d9-4f0a-869f-1e35dc6ca82a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:17.641240 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-6e089353-167e-4b56-ad1b-2d8085d44a32 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:17.650976 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-6e089353-167e-4b56-ad1b-2d8085d44a32 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:17.657673 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-6e089353-167e-4b56-ad1b-2d8085d44a32 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:17.657673 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-6e089353-167e-4b56-ad1b-2d8085d44a32 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1739 microversion: 2.20 time: 0.308788 Jun 27 18:47:17.662363 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 111/234] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:17 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1739 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:17.677187 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-512d5552-a4b7-4021-aa18-eaa0f4897d03 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:47:17.680329 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-512d5552-a4b7-4021-aa18-eaa0f4897d03 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:17.688338 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-512d5552-a4b7-4021-aa18-eaa0f4897d03 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:17.688509 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-512d5552-a4b7-4021-aa18-eaa0f4897d03 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:17.689669 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-512d5552-a4b7-4021-aa18-eaa0f4897d03 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:17.690284 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-512d5552-a4b7-4021-aa18-eaa0f4897d03 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:17.708725 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-fafa9c7a-a1d9-4f0a-869f-1e35dc6ca82a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:17.716925 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.objects.instance [None req-512d5552-a4b7-4021-aa18-eaa0f4897d03 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lazy-loading 'flavor' on Instance uuid b43630d1-a618-48b7-9837-b88b6f99fe34 {{(pid=124717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:47:17.721297 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-fafa9c7a-a1d9-4f0a-869f-1e35dc6ca82a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.324647 Jun 27 18:47:17.722038 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 124/235] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:17 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:18.053860 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-512d5552-a4b7-4021-aa18-eaa0f4897d03 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "POST /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34/action" status: 200 len: 32 microversion: 2.1 time: 0.389880 Jun 27 18:47:18.055509 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 112/236] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Jun 27 18:47:17 2022] POST /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34/action => generated 32 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 18:47:18.080088 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-846670ba-983f-4f17-bcf2-757221e4ce3b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:18.081509 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-846670ba-983f-4f17-bcf2-757221e4ce3b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:18.088233 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-846670ba-983f-4f17-bcf2-757221e4ce3b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:18.088707 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-846670ba-983f-4f17-bcf2-757221e4ce3b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:18.093371 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-846670ba-983f-4f17-bcf2-757221e4ce3b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:18.093822 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-846670ba-983f-4f17-bcf2-757221e4ce3b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:18.379805 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-846670ba-983f-4f17-bcf2-757221e4ce3b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:18.413544 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-846670ba-983f-4f17-bcf2-757221e4ce3b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.343837 Jun 27 18:47:18.421732 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 125/237] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:18 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:18.680544 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-c83e36cf-1470-4b4e-8f83-6c664e8a6853 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:18.681392 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-c83e36cf-1470-4b4e-8f83-6c664e8a6853 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:18.688673 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c83e36cf-1470-4b4e-8f83-6c664e8a6853 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:18.689144 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c83e36cf-1470-4b4e-8f83-6c664e8a6853 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:18.696417 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c83e36cf-1470-4b4e-8f83-6c664e8a6853 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:18.696417 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c83e36cf-1470-4b4e-8f83-6c664e8a6853 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:18.745431 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a0897807-e2c3-4b17-8f4f-2914d9e8cbd5 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:18.746362 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a0897807-e2c3-4b17-8f4f-2914d9e8cbd5 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:18.752506 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a0897807-e2c3-4b17-8f4f-2914d9e8cbd5 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:18.753327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a0897807-e2c3-4b17-8f4f-2914d9e8cbd5 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:18.753712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a0897807-e2c3-4b17-8f4f-2914d9e8cbd5 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:18.754152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a0897807-e2c3-4b17-8f4f-2914d9e8cbd5 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:19.035202 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-c83e36cf-1470-4b4e-8f83-6c664e8a6853 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:19.045156 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-c83e36cf-1470-4b4e-8f83-6c664e8a6853 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:19.046912 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-c83e36cf-1470-4b4e-8f83-6c664e8a6853 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:19.048141 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-c83e36cf-1470-4b4e-8f83-6c664e8a6853 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1739 microversion: 2.20 time: 0.372363 Jun 27 18:47:19.050288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 113/238] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:18 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1739 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:19.054778 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a0897807-e2c3-4b17-8f4f-2914d9e8cbd5 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:19.063610 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a0897807-e2c3-4b17-8f4f-2914d9e8cbd5 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.326564 Jun 27 18:47:19.074195 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 126/239] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:18 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:19.437571 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-9f9c216a-8c83-49e7-8dbc-6770310af3b5 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:19.439145 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-9f9c216a-8c83-49e7-8dbc-6770310af3b5 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:19.446805 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9f9c216a-8c83-49e7-8dbc-6770310af3b5 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:19.447249 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9f9c216a-8c83-49e7-8dbc-6770310af3b5 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:19.448019 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9f9c216a-8c83-49e7-8dbc-6770310af3b5 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:19.448445 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9f9c216a-8c83-49e7-8dbc-6770310af3b5 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:19.627393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-9f9c216a-8c83-49e7-8dbc-6770310af3b5 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:19.638072 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-9f9c216a-8c83-49e7-8dbc-6770310af3b5 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.205924 Jun 27 18:47:19.648843 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 114/240] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:19 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:20.071385 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-289c8149-8b55-4232-b7a0-e28c471ebb4d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:20.072042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-289c8149-8b55-4232-b7a0-e28c471ebb4d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:20.086371 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-1b1394c7-95a3-482d-8b2c-7fcf74274d0a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:20.099329 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-1b1394c7-95a3-482d-8b2c-7fcf74274d0a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:20.099484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-289c8149-8b55-4232-b7a0-e28c471ebb4d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:20.099484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-289c8149-8b55-4232-b7a0-e28c471ebb4d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:20.099484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-289c8149-8b55-4232-b7a0-e28c471ebb4d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:20.099484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-289c8149-8b55-4232-b7a0-e28c471ebb4d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:20.115708 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1b1394c7-95a3-482d-8b2c-7fcf74274d0a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:20.115708 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1b1394c7-95a3-482d-8b2c-7fcf74274d0a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:20.115708 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1b1394c7-95a3-482d-8b2c-7fcf74274d0a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:20.117673 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1b1394c7-95a3-482d-8b2c-7fcf74274d0a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:20.361110 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-289c8149-8b55-4232-b7a0-e28c471ebb4d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:20.371810 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-289c8149-8b55-4232-b7a0-e28c471ebb4d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:20.373000 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-1b1394c7-95a3-482d-8b2c-7fcf74274d0a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:20.373303 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-289c8149-8b55-4232-b7a0-e28c471ebb4d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:20.374536 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-289c8149-8b55-4232-b7a0-e28c471ebb4d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1739 microversion: 2.20 time: 0.309230 Jun 27 18:47:20.376904 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 127/241] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:20 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1739 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:20.382250 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-1b1394c7-95a3-482d-8b2c-7fcf74274d0a tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.300361 Jun 27 18:47:20.382861 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 115/242] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:20 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:20.657614 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-e73d43fc-f1e0-4826-98b5-94065d1e31ff tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:20.658153 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-e73d43fc-f1e0-4826-98b5-94065d1e31ff tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:20.664916 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e73d43fc-f1e0-4826-98b5-94065d1e31ff tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:20.665369 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e73d43fc-f1e0-4826-98b5-94065d1e31ff tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:20.666136 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e73d43fc-f1e0-4826-98b5-94065d1e31ff tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:20.666609 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e73d43fc-f1e0-4826-98b5-94065d1e31ff tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:20.802504 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-e73d43fc-f1e0-4826-98b5-94065d1e31ff tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:20.809841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-e73d43fc-f1e0-4826-98b5-94065d1e31ff tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.156901 Jun 27 18:47:20.810425 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 128/243] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:20 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:21.393330 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-f5484887-98c6-4607-b902-02c7ade2d24f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:21.393941 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-f5484887-98c6-4607-b902-02c7ade2d24f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:21.403167 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f5484887-98c6-4607-b902-02c7ade2d24f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:21.404007 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f5484887-98c6-4607-b902-02c7ade2d24f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:21.405360 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f5484887-98c6-4607-b902-02c7ade2d24f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:21.406063 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f5484887-98c6-4607-b902-02c7ade2d24f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:21.409029 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-8ff7b6b8-9b10-40e9-bfba-b2402c780b92 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:21.410714 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-8ff7b6b8-9b10-40e9-bfba-b2402c780b92 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:21.419960 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8ff7b6b8-9b10-40e9-bfba-b2402c780b92 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:21.421089 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8ff7b6b8-9b10-40e9-bfba-b2402c780b92 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:21.422268 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8ff7b6b8-9b10-40e9-bfba-b2402c780b92 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:21.422989 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8ff7b6b8-9b10-40e9-bfba-b2402c780b92 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:21.648330 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-f5484887-98c6-4607-b902-02c7ade2d24f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:21.657047 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-f5484887-98c6-4607-b902-02c7ade2d24f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:21.658580 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-f5484887-98c6-4607-b902-02c7ade2d24f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:21.659744 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-f5484887-98c6-4607-b902-02c7ade2d24f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1739 microversion: 2.20 time: 0.270420 Jun 27 18:47:21.667370 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 116/244] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:21 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1739 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:21.678360 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-8ff7b6b8-9b10-40e9-bfba-b2402c780b92 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:21.686672 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-8ff7b6b8-9b10-40e9-bfba-b2402c780b92 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.289208 Jun 27 18:47:21.687759 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 129/245] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:21 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:21.845519 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-b1818773-d95a-42f1-8d12-33d22b54c6da tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:21.846497 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-b1818773-d95a-42f1-8d12-33d22b54c6da tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:21.857716 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b1818773-d95a-42f1-8d12-33d22b54c6da tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:21.858637 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b1818773-d95a-42f1-8d12-33d22b54c6da tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:21.859607 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b1818773-d95a-42f1-8d12-33d22b54c6da tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:21.860222 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b1818773-d95a-42f1-8d12-33d22b54c6da tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:22.062285 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-b1818773-d95a-42f1-8d12-33d22b54c6da tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:22.072579 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-b1818773-d95a-42f1-8d12-33d22b54c6da tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.230115 Jun 27 18:47:22.072579 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 117/246] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:21 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:22.685256 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-6f71ed37-a78a-47f9-a763-e69ce3c01aff tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:22.685849 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-6f71ed37-a78a-47f9-a763-e69ce3c01aff tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:22.693551 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6f71ed37-a78a-47f9-a763-e69ce3c01aff tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:22.694027 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6f71ed37-a78a-47f9-a763-e69ce3c01aff tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:22.694831 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6f71ed37-a78a-47f9-a763-e69ce3c01aff tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:22.695261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6f71ed37-a78a-47f9-a763-e69ce3c01aff tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:22.707084 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-28cd0300-d604-40e0-8bc4-49c35a3d10ef tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:22.712171 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-28cd0300-d604-40e0-8bc4-49c35a3d10ef tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:22.719897 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-28cd0300-d604-40e0-8bc4-49c35a3d10ef tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:22.720461 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-28cd0300-d604-40e0-8bc4-49c35a3d10ef tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:22.721360 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-28cd0300-d604-40e0-8bc4-49c35a3d10ef tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:22.721866 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-28cd0300-d604-40e0-8bc4-49c35a3d10ef tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:22.916585 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-6f71ed37-a78a-47f9-a763-e69ce3c01aff tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:22.930136 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-28cd0300-d604-40e0-8bc4-49c35a3d10ef tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:22.935696 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-6f71ed37-a78a-47f9-a763-e69ce3c01aff tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:22.937195 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-6f71ed37-a78a-47f9-a763-e69ce3c01aff tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:22.938407 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-6f71ed37-a78a-47f9-a763-e69ce3c01aff tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1739 microversion: 2.20 time: 0.257221 Jun 27 18:47:22.944209 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-28cd0300-d604-40e0-8bc4-49c35a3d10ef tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.241376 Jun 27 18:47:22.944790 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 118/247] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:22 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:22.945055 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 130/248] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:22 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:23.089537 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0bd12c47-e2f0-4df9-b593-126849c9f10f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:23.090845 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-0bd12c47-e2f0-4df9-b593-126849c9f10f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:23.097163 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0bd12c47-e2f0-4df9-b593-126849c9f10f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:23.097807 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0bd12c47-e2f0-4df9-b593-126849c9f10f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:23.099109 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0bd12c47-e2f0-4df9-b593-126849c9f10f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:23.099556 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0bd12c47-e2f0-4df9-b593-126849c9f10f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:23.253569 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-0bd12c47-e2f0-4df9-b593-126849c9f10f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:23.266550 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-0bd12c47-e2f0-4df9-b593-126849c9f10f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.181990 Jun 27 18:47:23.279394 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 119/249] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:23 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:23.956987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-17f4fa01-10c2-4c0e-b424-51a9838cb455 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:23.957829 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-17f4fa01-10c2-4c0e-b424-51a9838cb455 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:23.962831 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-1e798f46-4b57-48cf-a905-d53147c2f4fa tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:23.963632 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-1e798f46-4b57-48cf-a905-d53147c2f4fa tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:23.964207 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-17f4fa01-10c2-4c0e-b424-51a9838cb455 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:23.964328 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-17f4fa01-10c2-4c0e-b424-51a9838cb455 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:23.965129 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-17f4fa01-10c2-4c0e-b424-51a9838cb455 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:23.965560 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-17f4fa01-10c2-4c0e-b424-51a9838cb455 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:23.970407 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1e798f46-4b57-48cf-a905-d53147c2f4fa tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:23.970918 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1e798f46-4b57-48cf-a905-d53147c2f4fa tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:23.971687 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1e798f46-4b57-48cf-a905-d53147c2f4fa tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:23.972122 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1e798f46-4b57-48cf-a905-d53147c2f4fa tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:24.108375 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-17f4fa01-10c2-4c0e-b424-51a9838cb455 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:24.119970 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-17f4fa01-10c2-4c0e-b424-51a9838cb455 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:24.121740 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-17f4fa01-10c2-4c0e-b424-51a9838cb455 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:24.123752 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-17f4fa01-10c2-4c0e-b424-51a9838cb455 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1739 microversion: 2.20 time: 0.170553 Jun 27 18:47:24.134746 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 131/250] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:23 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:24.281419 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-1e798f46-4b57-48cf-a905-d53147c2f4fa tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:24.295120 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-773a7146-e472-47ba-a877-a8f041895248 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:24.295120 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-773a7146-e472-47ba-a877-a8f041895248 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:24.310674 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-773a7146-e472-47ba-a877-a8f041895248 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:24.311345 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-773a7146-e472-47ba-a877-a8f041895248 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:24.311942 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-1e798f46-4b57-48cf-a905-d53147c2f4fa tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.352797 Jun 27 18:47:24.313753 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 120/251] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:23 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:24.323696 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-773a7146-e472-47ba-a877-a8f041895248 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:24.329204 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-773a7146-e472-47ba-a877-a8f041895248 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:24.495857 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-773a7146-e472-47ba-a877-a8f041895248 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:24.506838 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-773a7146-e472-47ba-a877-a8f041895248 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.220093 Jun 27 18:47:24.511843 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 132/252] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:24 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:25.144137 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-28acda51-469c-4d2d-b8f8-67604afb7223 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:25.145044 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-28acda51-469c-4d2d-b8f8-67604afb7223 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:25.155576 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-28acda51-469c-4d2d-b8f8-67604afb7223 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:25.155576 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-28acda51-469c-4d2d-b8f8-67604afb7223 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:25.155576 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-28acda51-469c-4d2d-b8f8-67604afb7223 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:25.155576 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-28acda51-469c-4d2d-b8f8-67604afb7223 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:25.286703 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-28acda51-469c-4d2d-b8f8-67604afb7223 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:25.294541 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-28acda51-469c-4d2d-b8f8-67604afb7223 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:25.298740 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-28acda51-469c-4d2d-b8f8-67604afb7223 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:25.298740 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-28acda51-469c-4d2d-b8f8-67604afb7223 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1739 microversion: 2.20 time: 0.157750 Jun 27 18:47:25.298740 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 121/253] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:25 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:47:25.332896 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-5e91a96e-3a2d-4f8c-adf4-3fe1cabd6d64 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:25.333503 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-5e91a96e-3a2d-4f8c-adf4-3fe1cabd6d64 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:25.339657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5e91a96e-3a2d-4f8c-adf4-3fe1cabd6d64 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:25.340094 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5e91a96e-3a2d-4f8c-adf4-3fe1cabd6d64 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:25.340843 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5e91a96e-3a2d-4f8c-adf4-3fe1cabd6d64 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:25.341270 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5e91a96e-3a2d-4f8c-adf4-3fe1cabd6d64 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:25.474204 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-5e91a96e-3a2d-4f8c-adf4-3fe1cabd6d64 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:25.482244 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-5e91a96e-3a2d-4f8c-adf4-3fe1cabd6d64 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.153291 Jun 27 18:47:25.482823 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 133/254] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:25 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:25.523949 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-4351fb5e-4f83-49ca-9fc2-d385f4b143f3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:25.524570 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-4351fb5e-4f83-49ca-9fc2-d385f4b143f3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:25.530565 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4351fb5e-4f83-49ca-9fc2-d385f4b143f3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:25.531015 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4351fb5e-4f83-49ca-9fc2-d385f4b143f3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:25.531772 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4351fb5e-4f83-49ca-9fc2-d385f4b143f3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:25.532211 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4351fb5e-4f83-49ca-9fc2-d385f4b143f3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:25.660275 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-4351fb5e-4f83-49ca-9fc2-d385f4b143f3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:25.668102 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-4351fb5e-4f83-49ca-9fc2-d385f4b143f3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.148270 Jun 27 18:47:25.668655 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 122/255] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:25 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:26.316864 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-31b3778c-0111-4d12-9b68-8944617277f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:26.317388 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-31b3778c-0111-4d12-9b68-8944617277f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:26.323999 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-31b3778c-0111-4d12-9b68-8944617277f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:26.324444 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-31b3778c-0111-4d12-9b68-8944617277f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:26.325198 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-31b3778c-0111-4d12-9b68-8944617277f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:26.325634 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-31b3778c-0111-4d12-9b68-8944617277f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:26.455573 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-31b3778c-0111-4d12-9b68-8944617277f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:26.463540 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-31b3778c-0111-4d12-9b68-8944617277f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:26.465047 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-31b3778c-0111-4d12-9b68-8944617277f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:26.466210 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-31b3778c-0111-4d12-9b68-8944617277f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1739 microversion: 2.20 time: 0.153321 Jun 27 18:47:26.466788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 134/256] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:26 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:26.499900 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-2a4fcac1-97ab-4cae-8268-3639c5042490 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:26.500509 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-2a4fcac1-97ab-4cae-8268-3639c5042490 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:26.508966 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2a4fcac1-97ab-4cae-8268-3639c5042490 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:26.509409 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2a4fcac1-97ab-4cae-8268-3639c5042490 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:26.510162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2a4fcac1-97ab-4cae-8268-3639c5042490 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:26.510621 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2a4fcac1-97ab-4cae-8268-3639c5042490 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:26.635484 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-2a4fcac1-97ab-4cae-8268-3639c5042490 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:26.643338 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-2a4fcac1-97ab-4cae-8268-3639c5042490 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.147254 Jun 27 18:47:26.643901 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 123/257] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:26 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:26.685372 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-967093bc-999d-463b-9eb2-cb2700af0baf tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:26.685982 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-967093bc-999d-463b-9eb2-cb2700af0baf tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:26.691885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-967093bc-999d-463b-9eb2-cb2700af0baf tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:26.692326 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-967093bc-999d-463b-9eb2-cb2700af0baf tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:26.693073 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-967093bc-999d-463b-9eb2-cb2700af0baf tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:26.693502 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-967093bc-999d-463b-9eb2-cb2700af0baf tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:26.696683 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=100 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:47:26.827597 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-967093bc-999d-463b-9eb2-cb2700af0baf tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:26.835733 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-967093bc-999d-463b-9eb2-cb2700af0baf tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.153513 Jun 27 18:47:26.836245 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 135/258] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:26 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:27.483526 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-52bd9ad6-295a-43e3-b282-743a46c5e75d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:27.484142 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-52bd9ad6-295a-43e3-b282-743a46c5e75d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:27.486229 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:47:27.490832 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-52bd9ad6-295a-43e3-b282-743a46c5e75d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:27.491788 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-52bd9ad6-295a-43e3-b282-743a46c5e75d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:27.492551 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-52bd9ad6-295a-43e3-b282-743a46c5e75d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:27.493032 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-52bd9ad6-295a-43e3-b282-743a46c5e75d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:27.502443 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:47:27.620460 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-52bd9ad6-295a-43e3-b282-743a46c5e75d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:27.628374 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-52bd9ad6-295a-43e3-b282-743a46c5e75d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:27.629929 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-52bd9ad6-295a-43e3-b282-743a46c5e75d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:27.631133 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-52bd9ad6-295a-43e3-b282-743a46c5e75d tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1739 microversion: 2.20 time: 0.151783 Jun 27 18:47:27.631712 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 124/259] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:27 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:27.659886 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-6175d2f6-8069-40a7-9aed-b330f4342fb6 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:27.660498 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-6175d2f6-8069-40a7-9aed-b330f4342fb6 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:27.667903 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6175d2f6-8069-40a7-9aed-b330f4342fb6 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:27.668351 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6175d2f6-8069-40a7-9aed-b330f4342fb6 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:27.669110 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6175d2f6-8069-40a7-9aed-b330f4342fb6 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:27.669547 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6175d2f6-8069-40a7-9aed-b330f4342fb6 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:27.797196 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-6175d2f6-8069-40a7-9aed-b330f4342fb6 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:27.806141 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-6175d2f6-8069-40a7-9aed-b330f4342fb6 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.150112 Jun 27 18:47:27.806897 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 136/260] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:27 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:27.851968 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-b0faaa40-df3f-4694-9adb-c8605f746061 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:27.852579 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-b0faaa40-df3f-4694-9adb-c8605f746061 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:27.859900 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b0faaa40-df3f-4694-9adb-c8605f746061 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:27.860347 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b0faaa40-df3f-4694-9adb-c8605f746061 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:27.861104 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b0faaa40-df3f-4694-9adb-c8605f746061 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:27.861540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b0faaa40-df3f-4694-9adb-c8605f746061 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:27.997529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-b0faaa40-df3f-4694-9adb-c8605f746061 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:28.004907 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-b0faaa40-df3f-4694-9adb-c8605f746061 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.157435 Jun 27 18:47:28.005464 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 125/261] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:27 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:28.649057 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a7d2a978-1ea7-49c6-a481-309d42276fa9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:28.650135 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a7d2a978-1ea7-49c6-a481-309d42276fa9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:28.652563 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_api:SELECT=77 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:47:28.658097 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a7d2a978-1ea7-49c6-a481-309d42276fa9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:28.658660 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a7d2a978-1ea7-49c6-a481-309d42276fa9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:28.659445 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a7d2a978-1ea7-49c6-a481-309d42276fa9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:28.659879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a7d2a978-1ea7-49c6-a481-309d42276fa9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:28.826320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-feeda61b-961b-45a8-bc8e-13d9224f436c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:28.826320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-feeda61b-961b-45a8-bc8e-13d9224f436c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:28.840020 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-feeda61b-961b-45a8-bc8e-13d9224f436c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:28.840475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-feeda61b-961b-45a8-bc8e-13d9224f436c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:28.841408 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-feeda61b-961b-45a8-bc8e-13d9224f436c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:28.841854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-feeda61b-961b-45a8-bc8e-13d9224f436c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:28.871304 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a7d2a978-1ea7-49c6-a481-309d42276fa9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:28.880560 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a7d2a978-1ea7-49c6-a481-309d42276fa9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:28.882126 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a7d2a978-1ea7-49c6-a481-309d42276fa9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:28.883334 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a7d2a978-1ea7-49c6-a481-309d42276fa9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1721 microversion: 2.20 time: 0.238245 Jun 27 18:47:28.884244 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 137/262] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:28 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:29.021050 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-4e22401a-daac-4765-8d09-22bbcec1e896 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:29.021668 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-4e22401a-daac-4765-8d09-22bbcec1e896 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:29.028467 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4e22401a-daac-4765-8d09-22bbcec1e896 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:29.029039 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4e22401a-daac-4765-8d09-22bbcec1e896 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:29.029705 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4e22401a-daac-4765-8d09-22bbcec1e896 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:29.030152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4e22401a-daac-4765-8d09-22bbcec1e896 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:29.061785 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-feeda61b-961b-45a8-bc8e-13d9224f436c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:29.071262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-feeda61b-961b-45a8-bc8e-13d9224f436c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.250870 Jun 27 18:47:29.071936 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 126/263] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:28 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:29.254803 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-4e22401a-daac-4765-8d09-22bbcec1e896 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:29.263451 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-4e22401a-daac-4765-8d09-22bbcec1e896 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.246290 Jun 27 18:47:29.264116 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 138/264] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:29 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:29.902535 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-83a5f78b-b645-47bf-8793-732128759275 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:29.903072 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-83a5f78b-b645-47bf-8793-732128759275 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:29.910016 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-83a5f78b-b645-47bf-8793-732128759275 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:29.910503 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-83a5f78b-b645-47bf-8793-732128759275 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:29.911279 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-83a5f78b-b645-47bf-8793-732128759275 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:29.911718 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-83a5f78b-b645-47bf-8793-732128759275 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:30.054026 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-83a5f78b-b645-47bf-8793-732128759275 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:30.061851 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-83a5f78b-b645-47bf-8793-732128759275 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:30.063422 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-83a5f78b-b645-47bf-8793-732128759275 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:30.064583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-83a5f78b-b645-47bf-8793-732128759275 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1721 microversion: 2.20 time: 0.166358 Jun 27 18:47:30.065142 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 127/265] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:29 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:30.089164 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-64ce84ab-c9ec-42ac-bb96-8a25478b35e1 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:30.091104 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-64ce84ab-c9ec-42ac-bb96-8a25478b35e1 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:30.096563 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-64ce84ab-c9ec-42ac-bb96-8a25478b35e1 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:30.097020 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-64ce84ab-c9ec-42ac-bb96-8a25478b35e1 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:30.097801 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-64ce84ab-c9ec-42ac-bb96-8a25478b35e1 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:30.098240 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-64ce84ab-c9ec-42ac-bb96-8a25478b35e1 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:30.227374 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-64ce84ab-c9ec-42ac-bb96-8a25478b35e1 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:30.235590 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-64ce84ab-c9ec-42ac-bb96-8a25478b35e1 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.151124 Jun 27 18:47:30.236177 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 139/266] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:30 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:30.281454 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a470ebdb-9736-4c96-a774-1d6041de1138 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:30.282136 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-a470ebdb-9736-4c96-a774-1d6041de1138 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:30.288760 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a470ebdb-9736-4c96-a774-1d6041de1138 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:30.297694 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a470ebdb-9736-4c96-a774-1d6041de1138 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:30.297694 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a470ebdb-9736-4c96-a774-1d6041de1138 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:30.297694 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a470ebdb-9736-4c96-a774-1d6041de1138 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:30.428927 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a470ebdb-9736-4c96-a774-1d6041de1138 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:30.436519 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-a470ebdb-9736-4c96-a774-1d6041de1138 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.159007 Jun 27 18:47:30.437075 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 128/267] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:30 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:31.084115 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-0aa50215-d23e-4976-9599-9a671ee5bf22 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:31.085069 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-0aa50215-d23e-4976-9599-9a671ee5bf22 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:31.091739 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0aa50215-d23e-4976-9599-9a671ee5bf22 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:31.092394 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0aa50215-d23e-4976-9599-9a671ee5bf22 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:31.092930 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0aa50215-d23e-4976-9599-9a671ee5bf22 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:31.093373 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0aa50215-d23e-4976-9599-9a671ee5bf22 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:31.222843 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-0aa50215-d23e-4976-9599-9a671ee5bf22 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:31.231207 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-0aa50215-d23e-4976-9599-9a671ee5bf22 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:31.232686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-0aa50215-d23e-4976-9599-9a671ee5bf22 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:31.233966 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-0aa50215-d23e-4976-9599-9a671ee5bf22 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1721 microversion: 2.20 time: 0.153685 Jun 27 18:47:31.234690 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 140/268] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:31 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:31.253286 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-604543d2-d3c6-4d8b-9461-a6120e44dbeb tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:31.253900 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-604543d2-d3c6-4d8b-9461-a6120e44dbeb tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:31.261059 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-604543d2-d3c6-4d8b-9461-a6120e44dbeb tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:31.261509 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-604543d2-d3c6-4d8b-9461-a6120e44dbeb tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:31.262269 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-604543d2-d3c6-4d8b-9461-a6120e44dbeb tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:31.262756 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-604543d2-d3c6-4d8b-9461-a6120e44dbeb tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:31.398333 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-604543d2-d3c6-4d8b-9461-a6120e44dbeb tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:31.406786 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-604543d2-d3c6-4d8b-9461-a6120e44dbeb tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.157384 Jun 27 18:47:31.407351 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 129/269] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:31 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:31.455226 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-1451a00f-0964-400b-be12-470e0f279b7c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:31.455840 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-1451a00f-0964-400b-be12-470e0f279b7c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:31.462537 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1451a00f-0964-400b-be12-470e0f279b7c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:31.464696 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1451a00f-0964-400b-be12-470e0f279b7c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:31.465547 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1451a00f-0964-400b-be12-470e0f279b7c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:31.465992 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1451a00f-0964-400b-be12-470e0f279b7c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:31.806776 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-1451a00f-0964-400b-be12-470e0f279b7c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:31.814457 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-1451a00f-0964-400b-be12-470e0f279b7c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.363309 Jun 27 18:47:31.815027 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 141/270] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:31 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:32.254639 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-6a170833-172b-4bde-b1e5-2b606b530627 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:32.255257 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-6a170833-172b-4bde-b1e5-2b606b530627 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:32.262732 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6a170833-172b-4bde-b1e5-2b606b530627 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:32.263119 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6a170833-172b-4bde-b1e5-2b606b530627 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:32.264018 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6a170833-172b-4bde-b1e5-2b606b530627 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:32.264453 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6a170833-172b-4bde-b1e5-2b606b530627 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:32.359493 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-310d32de-096b-40fb-ab4c-f2c1cd70a295 req-b4491456-4583-446d-968b-0dc9f38099f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91366512-6fa4-4a20-a867-94852749b02f", "name": "network-vif-unplugged", "status": "completed", "tag": "3ca020b2-805d-45e4-9147-1a3d32b54834"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:47:32.368878 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-310d32de-096b-40fb-ab4c-f2c1cd70a295 req-b4491456-4583-446d-968b-0dc9f38099f6 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:32.369552 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-310d32de-096b-40fb-ab4c-f2c1cd70a295 req-b4491456-4583-446d-968b-0dc9f38099f6 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:32.381254 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.compute.server_external_events [req-310d32de-096b-40fb-ab4c-f2c1cd70a295 req-b4491456-4583-446d-968b-0dc9f38099f6 service nova] Unable to find a host for instance 91366512-6fa4-4a20-a867-94852749b02f. Dropping event network-vif-unplugged {{(pid=124716) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 27 18:47:32.382172 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-310d32de-096b-40fb-ab4c-f2c1cd70a295 req-b4491456-4583-446d-968b-0dc9f38099f6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028182 Jun 27 18:47:32.383086 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 142/271] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 27 18:47:32.411903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-6a170833-172b-4bde-b1e5-2b606b530627 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:32.420353 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-6a170833-172b-4bde-b1e5-2b606b530627 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:32.421961 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-6a170833-172b-4bde-b1e5-2b606b530627 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:32.423440 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-6a170833-172b-4bde-b1e5-2b606b530627 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1724 microversion: 2.20 time: 0.172851 Jun 27 18:47:32.423992 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 130/272] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:32 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:32.427760 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-4c388630-1dff-48cc-9911-d2a85f0f390b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:32.428431 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-4c388630-1dff-48cc-9911-d2a85f0f390b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:32.434688 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4c388630-1dff-48cc-9911-d2a85f0f390b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:32.435141 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4c388630-1dff-48cc-9911-d2a85f0f390b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:32.435905 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4c388630-1dff-48cc-9911-d2a85f0f390b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:32.436345 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4c388630-1dff-48cc-9911-d2a85f0f390b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:32.442830 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-9b2d6b4f-bd46-4b78-a8c9-aba52a17aa9c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f2417cc-55de-41b5-9732-a5426c2e1066"}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:47:32.444377 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-9b2d6b4f-bd46-4b78-a8c9-aba52a17aa9c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:32.450582 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9b2d6b4f-bd46-4b78-a8c9-aba52a17aa9c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:32.451478 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9b2d6b4f-bd46-4b78-a8c9-aba52a17aa9c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:32.452583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9b2d6b4f-bd46-4b78-a8c9-aba52a17aa9c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:32.453084 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9b2d6b4f-bd46-4b78-a8c9-aba52a17aa9c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:32.592899 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-4c388630-1dff-48cc-9911-d2a85f0f390b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:32.602061 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-4c388630-1dff-48cc-9911-d2a85f0f390b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.178377 Jun 27 18:47:32.603874 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 143/273] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:32 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:32.834065 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-fa77cb02-49d7-459f-82d4-da222ddd9e09 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:32.835314 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-fa77cb02-49d7-459f-82d4-da222ddd9e09 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:32.841400 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fa77cb02-49d7-459f-82d4-da222ddd9e09 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:32.841844 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fa77cb02-49d7-459f-82d4-da222ddd9e09 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:32.842624 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fa77cb02-49d7-459f-82d4-da222ddd9e09 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:32.851796 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fa77cb02-49d7-459f-82d4-da222ddd9e09 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:32.985941 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-fa77cb02-49d7-459f-82d4-da222ddd9e09 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:32.994194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-fa77cb02-49d7-459f-82d4-da222ddd9e09 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.163966 Jun 27 18:47:32.994803 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 144/274] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:32 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:33.620384 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-3ba5f4e2-4964-49ae-8b4b-dc32bfdbe390 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:33.621011 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-3ba5f4e2-4964-49ae-8b4b-dc32bfdbe390 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:33.628583 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3ba5f4e2-4964-49ae-8b4b-dc32bfdbe390 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:33.628583 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3ba5f4e2-4964-49ae-8b4b-dc32bfdbe390 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:33.629191 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3ba5f4e2-4964-49ae-8b4b-dc32bfdbe390 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:33.629466 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3ba5f4e2-4964-49ae-8b4b-dc32bfdbe390 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:33.774465 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3ba5f4e2-4964-49ae-8b4b-dc32bfdbe390 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:33.782484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-3ba5f4e2-4964-49ae-8b4b-dc32bfdbe390 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.166494 Jun 27 18:47:33.783044 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 145/275] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:33 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:33.822125 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-9b2d6b4f-bd46-4b78-a8c9-aba52a17aa9c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "POST /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.384026 Jun 27 18:47:33.822804 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 131/276] 10.222.0.15 () {62 vars in 1363 bytes} [Mon Jun 27 18:47:32 2022] POST /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f/os-volume_attachments => generated 188 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 18:47:33.938699 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-ba2c4d3e-f5d7-4103-a19b-378d397df95b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:47:33.939272 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-ba2c4d3e-f5d7-4103-a19b-378d397df95b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:33.945337 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ba2c4d3e-f5d7-4103-a19b-378d397df95b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:33.945782 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ba2c4d3e-f5d7-4103-a19b-378d397df95b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:33.946580 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ba2c4d3e-f5d7-4103-a19b-378d397df95b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:33.947020 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ba2c4d3e-f5d7-4103-a19b-378d397df95b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:34.010993 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-bd1d1f05-1757-4c82-9f59-dcfb131e5d62 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:34.011614 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-bd1d1f05-1757-4c82-9f59-dcfb131e5d62 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:34.017554 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bd1d1f05-1757-4c82-9f59-dcfb131e5d62 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:34.018011 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bd1d1f05-1757-4c82-9f59-dcfb131e5d62 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:34.018817 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bd1d1f05-1757-4c82-9f59-dcfb131e5d62 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:34.019276 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bd1d1f05-1757-4c82-9f59-dcfb131e5d62 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:34.150543 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-bd1d1f05-1757-4c82-9f59-dcfb131e5d62 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:34.158359 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-bd1d1f05-1757-4c82-9f59-dcfb131e5d62 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.151491 Jun 27 18:47:34.158956 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 132/277] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:34 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:34.159186 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-ba2c4d3e-f5d7-4103-a19b-378d397df95b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "POST /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f/action" status: 202 len: 0 microversion: 2.20 time: 0.224331 Jun 27 18:47:34.159808 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 146/278] 10.222.0.15 () {62 vars in 1318 bytes} [Mon Jun 27 18:47:33 2022] POST /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 18:47:34.169453 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-576cc143-890c-4ee7-97f4-9c594909e622 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:34.170350 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-576cc143-890c-4ee7-97f4-9c594909e622 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:34.176997 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-576cc143-890c-4ee7-97f4-9c594909e622 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:34.177449 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-576cc143-890c-4ee7-97f4-9c594909e622 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:34.178435 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-576cc143-890c-4ee7-97f4-9c594909e622 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:34.178884 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-576cc143-890c-4ee7-97f4-9c594909e622 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:34.311799 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-576cc143-890c-4ee7-97f4-9c594909e622 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:34.321121 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-576cc143-890c-4ee7-97f4-9c594909e622 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:34.322662 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-576cc143-890c-4ee7-97f4-9c594909e622 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:34.323853 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-576cc143-890c-4ee7-97f4-9c594909e622 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1750 microversion: 2.20 time: 0.158551 Jun 27 18:47:34.324412 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 133/279] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:34 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1750 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:34.799379 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-575d5345-0d69-4aa6-bf02-23f2e2fcf662 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:34.799999 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-575d5345-0d69-4aa6-bf02-23f2e2fcf662 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:34.806713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-575d5345-0d69-4aa6-bf02-23f2e2fcf662 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:34.807160 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-575d5345-0d69-4aa6-bf02-23f2e2fcf662 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:34.807932 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-575d5345-0d69-4aa6-bf02-23f2e2fcf662 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:34.808537 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-575d5345-0d69-4aa6-bf02-23f2e2fcf662 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:34.941830 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-575d5345-0d69-4aa6-bf02-23f2e2fcf662 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:34.950903 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-575d5345-0d69-4aa6-bf02-23f2e2fcf662 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.155382 Jun 27 18:47:34.951463 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 147/280] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:34 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:35.175537 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-aff38d2f-f779-4672-91d3-ba7c1d7ef443 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:35.176186 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-aff38d2f-f779-4672-91d3-ba7c1d7ef443 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:35.185155 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-aff38d2f-f779-4672-91d3-ba7c1d7ef443 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:35.185790 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-aff38d2f-f779-4672-91d3-ba7c1d7ef443 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:35.186831 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-aff38d2f-f779-4672-91d3-ba7c1d7ef443 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:35.187358 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-aff38d2f-f779-4672-91d3-ba7c1d7ef443 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:35.320992 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-aff38d2f-f779-4672-91d3-ba7c1d7ef443 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:35.328804 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-aff38d2f-f779-4672-91d3-ba7c1d7ef443 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.157077 Jun 27 18:47:35.329391 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 134/281] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:35 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:35.343424 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-bb2b736f-a2e6-43c1-8187-6df1d7b50e49 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:35.344026 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-bb2b736f-a2e6-43c1-8187-6df1d7b50e49 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:35.351051 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bb2b736f-a2e6-43c1-8187-6df1d7b50e49 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:35.351490 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bb2b736f-a2e6-43c1-8187-6df1d7b50e49 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:35.352437 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bb2b736f-a2e6-43c1-8187-6df1d7b50e49 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:35.352866 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bb2b736f-a2e6-43c1-8187-6df1d7b50e49 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:35.494561 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-bb2b736f-a2e6-43c1-8187-6df1d7b50e49 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:35.503101 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-bb2b736f-a2e6-43c1-8187-6df1d7b50e49 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:35.504829 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-bb2b736f-a2e6-43c1-8187-6df1d7b50e49 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:35.516470 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-bb2b736f-a2e6-43c1-8187-6df1d7b50e49 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1750 microversion: 2.20 time: 0.166988 Jun 27 18:47:35.517137 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 148/282] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:35 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:35.967968 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0bba6352-8d83-4122-bfc2-ee90f815fcd2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:35.968588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-0bba6352-8d83-4122-bfc2-ee90f815fcd2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:35.974630 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0bba6352-8d83-4122-bfc2-ee90f815fcd2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:35.975127 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0bba6352-8d83-4122-bfc2-ee90f815fcd2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:35.975887 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0bba6352-8d83-4122-bfc2-ee90f815fcd2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:35.976359 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0bba6352-8d83-4122-bfc2-ee90f815fcd2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:36.104039 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-0bba6352-8d83-4122-bfc2-ee90f815fcd2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:36.112802 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-0bba6352-8d83-4122-bfc2-ee90f815fcd2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.148624 Jun 27 18:47:36.113386 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 135/283] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:35 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:36.345240 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-d02d72c1-78d4-406f-9dad-47b0fc28b44c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:36.345872 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-d02d72c1-78d4-406f-9dad-47b0fc28b44c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:36.352749 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d02d72c1-78d4-406f-9dad-47b0fc28b44c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:36.353194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d02d72c1-78d4-406f-9dad-47b0fc28b44c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:36.353946 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d02d72c1-78d4-406f-9dad-47b0fc28b44c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:36.354462 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d02d72c1-78d4-406f-9dad-47b0fc28b44c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:36.486550 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-d02d72c1-78d4-406f-9dad-47b0fc28b44c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:36.494980 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-d02d72c1-78d4-406f-9dad-47b0fc28b44c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.153629 Jun 27 18:47:36.495544 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 149/284] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:36 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:36.535128 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-d91baf81-df62-4922-9dd2-0eff06682659 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:36.535775 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-d91baf81-df62-4922-9dd2-0eff06682659 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:36.543086 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d91baf81-df62-4922-9dd2-0eff06682659 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:36.543542 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d91baf81-df62-4922-9dd2-0eff06682659 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:36.544314 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d91baf81-df62-4922-9dd2-0eff06682659 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:36.544751 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d91baf81-df62-4922-9dd2-0eff06682659 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:36.677678 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-d91baf81-df62-4922-9dd2-0eff06682659 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:36.687077 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-d91baf81-df62-4922-9dd2-0eff06682659 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:36.689023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-d91baf81-df62-4922-9dd2-0eff06682659 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:36.690211 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-d91baf81-df62-4922-9dd2-0eff06682659 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1750 microversion: 2.20 time: 0.159219 Jun 27 18:47:36.690889 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 136/285] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:36 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1750 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:37.131343 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-3885a11d-e262-4852-a666-372b39af41ab tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:37.131967 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-3885a11d-e262-4852-a666-372b39af41ab tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:37.138227 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3885a11d-e262-4852-a666-372b39af41ab tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:37.138710 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3885a11d-e262-4852-a666-372b39af41ab tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:37.139476 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3885a11d-e262-4852-a666-372b39af41ab tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:37.139913 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3885a11d-e262-4852-a666-372b39af41ab tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:37.274405 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3885a11d-e262-4852-a666-372b39af41ab tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:37.282471 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-3885a11d-e262-4852-a666-372b39af41ab tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.155232 Jun 27 18:47:37.283037 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 150/286] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:37 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:37.512000 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e3ca5e26-5f57-4a47-a7a4-2036e3573639 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:37.512616 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e3ca5e26-5f57-4a47-a7a4-2036e3573639 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:37.518703 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e3ca5e26-5f57-4a47-a7a4-2036e3573639 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:37.519151 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e3ca5e26-5f57-4a47-a7a4-2036e3573639 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:37.519905 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e3ca5e26-5f57-4a47-a7a4-2036e3573639 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:37.520338 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e3ca5e26-5f57-4a47-a7a4-2036e3573639 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:37.655453 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-e3ca5e26-5f57-4a47-a7a4-2036e3573639 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:37.662935 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e3ca5e26-5f57-4a47-a7a4-2036e3573639 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.154986 Jun 27 18:47:37.663498 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 137/287] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:37 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:37.707219 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-c2a31583-ab66-413f-baf0-6028928f8b5a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:37.707832 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-c2a31583-ab66-413f-baf0-6028928f8b5a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:37.715083 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c2a31583-ab66-413f-baf0-6028928f8b5a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:37.715554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c2a31583-ab66-413f-baf0-6028928f8b5a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:37.716310 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c2a31583-ab66-413f-baf0-6028928f8b5a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:37.716760 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c2a31583-ab66-413f-baf0-6028928f8b5a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:37.732642 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:47:37.855710 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c2a31583-ab66-413f-baf0-6028928f8b5a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:37.864439 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c2a31583-ab66-413f-baf0-6028928f8b5a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:37.865986 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c2a31583-ab66-413f-baf0-6028928f8b5a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:37.867459 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-c2a31583-ab66-413f-baf0-6028928f8b5a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1752 microversion: 2.20 time: 0.164120 Jun 27 18:47:37.868011 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 151/288] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:37 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:38.301520 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-55b8cee5-355d-4c47-8313-feeb79375349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:38.302063 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-55b8cee5-355d-4c47-8313-feeb79375349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:38.309374 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-55b8cee5-355d-4c47-8313-feeb79375349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:38.309933 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-55b8cee5-355d-4c47-8313-feeb79375349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:38.310738 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-55b8cee5-355d-4c47-8313-feeb79375349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:38.311173 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-55b8cee5-355d-4c47-8313-feeb79375349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:38.314089 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:47:38.451612 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-55b8cee5-355d-4c47-8313-feeb79375349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:38.459551 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-55b8cee5-355d-4c47-8313-feeb79375349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.162390 Jun 27 18:47:38.460114 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 138/289] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:38 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:38.682341 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7b19284e-e931-4bec-961c-4189742e72d3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:38.682995 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-7b19284e-e931-4bec-961c-4189742e72d3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:38.690566 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7b19284e-e931-4bec-961c-4189742e72d3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:38.691285 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7b19284e-e931-4bec-961c-4189742e72d3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:38.692098 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7b19284e-e931-4bec-961c-4189742e72d3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:38.692564 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7b19284e-e931-4bec-961c-4189742e72d3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:38.827230 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-7b19284e-e931-4bec-961c-4189742e72d3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:38.834978 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-7b19284e-e931-4bec-961c-4189742e72d3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.157216 Jun 27 18:47:38.835546 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 152/290] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:38 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:38.888176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-99e28721-16b4-4bf6-9892-07e6d91a5611 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:38.888952 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-99e28721-16b4-4bf6-9892-07e6d91a5611 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:38.897165 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-99e28721-16b4-4bf6-9892-07e6d91a5611 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:38.897614 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-99e28721-16b4-4bf6-9892-07e6d91a5611 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:38.898440 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-99e28721-16b4-4bf6-9892-07e6d91a5611 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:38.898879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-99e28721-16b4-4bf6-9892-07e6d91a5611 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:39.033755 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-99e28721-16b4-4bf6-9892-07e6d91a5611 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:39.043606 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-99e28721-16b4-4bf6-9892-07e6d91a5611 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:39.045362 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-99e28721-16b4-4bf6-9892-07e6d91a5611 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:39.046912 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-99e28721-16b4-4bf6-9892-07e6d91a5611 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1808 microversion: 2.20 time: 0.164411 Jun 27 18:47:39.047495 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 139/291] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:38 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:39.477130 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-03dffa71-27c1-4263-ab72-538d51aeb4fa tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:39.478009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-03dffa71-27c1-4263-ab72-538d51aeb4fa tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:39.489901 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-03dffa71-27c1-4263-ab72-538d51aeb4fa tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:39.492522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-03dffa71-27c1-4263-ab72-538d51aeb4fa tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:39.493705 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-03dffa71-27c1-4263-ab72-538d51aeb4fa tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:39.494214 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-03dffa71-27c1-4263-ab72-538d51aeb4fa tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:39.751170 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-03dffa71-27c1-4263-ab72-538d51aeb4fa tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:39.760201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-03dffa71-27c1-4263-ab72-538d51aeb4fa tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.286663 Jun 27 18:47:39.760784 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 153/292] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:39 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:39.852549 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-7a33f78e-4f4d-427c-9bc0-648b6bb3f699 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:39.853268 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-7a33f78e-4f4d-427c-9bc0-648b6bb3f699 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:39.859802 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7a33f78e-4f4d-427c-9bc0-648b6bb3f699 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:39.860339 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7a33f78e-4f4d-427c-9bc0-648b6bb3f699 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:39.861213 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7a33f78e-4f4d-427c-9bc0-648b6bb3f699 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:39.861699 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7a33f78e-4f4d-427c-9bc0-648b6bb3f699 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:40.065957 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-7a33f78e-4f4d-427c-9bc0-648b6bb3f699 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:40.068100 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-2b9a52cf-a593-48b6-9086-f61903fbdfa4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:40.068725 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-2b9a52cf-a593-48b6-9086-f61903fbdfa4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:40.076515 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-7a33f78e-4f4d-427c-9bc0-648b6bb3f699 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.227361 Jun 27 18:47:40.076515 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 140/293] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:39 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:40.079621 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2b9a52cf-a593-48b6-9086-f61903fbdfa4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:40.080076 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2b9a52cf-a593-48b6-9086-f61903fbdfa4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:40.080860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2b9a52cf-a593-48b6-9086-f61903fbdfa4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:40.081300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2b9a52cf-a593-48b6-9086-f61903fbdfa4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:40.351099 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-2b9a52cf-a593-48b6-9086-f61903fbdfa4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:40.361526 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-2b9a52cf-a593-48b6-9086-f61903fbdfa4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:40.363219 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-2b9a52cf-a593-48b6-9086-f61903fbdfa4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:40.364567 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-2b9a52cf-a593-48b6-9086-f61903fbdfa4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1808 microversion: 2.20 time: 0.300319 Jun 27 18:47:40.365112 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 154/294] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:40 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1808 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:40.780662 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-3c6111bc-25b8-4754-82d6-d32e1c37dc54 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:40.783098 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-3c6111bc-25b8-4754-82d6-d32e1c37dc54 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:40.792656 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3c6111bc-25b8-4754-82d6-d32e1c37dc54 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:40.793574 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3c6111bc-25b8-4754-82d6-d32e1c37dc54 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:40.794889 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3c6111bc-25b8-4754-82d6-d32e1c37dc54 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:40.797110 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3c6111bc-25b8-4754-82d6-d32e1c37dc54 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:40.972948 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-3c6111bc-25b8-4754-82d6-d32e1c37dc54 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:40.993626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-3c6111bc-25b8-4754-82d6-d32e1c37dc54 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.218194 Jun 27 18:47:41.009039 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 141/295] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:40 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:41.096804 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-88d8ddf5-f6d8-4e25-8942-eeecc35c4c1d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:41.097568 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-88d8ddf5-f6d8-4e25-8942-eeecc35c4c1d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:41.105775 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-88d8ddf5-f6d8-4e25-8942-eeecc35c4c1d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:41.110121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-88d8ddf5-f6d8-4e25-8942-eeecc35c4c1d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:41.111184 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-88d8ddf5-f6d8-4e25-8942-eeecc35c4c1d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:41.111715 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-88d8ddf5-f6d8-4e25-8942-eeecc35c4c1d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:41.291815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-88d8ddf5-f6d8-4e25-8942-eeecc35c4c1d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:41.300438 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-88d8ddf5-f6d8-4e25-8942-eeecc35c4c1d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.208122 Jun 27 18:47:41.305646 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 155/296] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:41 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:41.384942 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-814b2e5c-611a-4b03-a329-2fcf797bb138 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:41.385591 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-814b2e5c-611a-4b03-a329-2fcf797bb138 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:41.391653 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-814b2e5c-611a-4b03-a329-2fcf797bb138 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:41.392101 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-814b2e5c-611a-4b03-a329-2fcf797bb138 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:41.392864 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-814b2e5c-611a-4b03-a329-2fcf797bb138 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:41.393297 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-814b2e5c-611a-4b03-a329-2fcf797bb138 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:41.555229 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-814b2e5c-611a-4b03-a329-2fcf797bb138 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:41.569765 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-814b2e5c-611a-4b03-a329-2fcf797bb138 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:41.572717 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-814b2e5c-611a-4b03-a329-2fcf797bb138 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:41.574012 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-814b2e5c-611a-4b03-a329-2fcf797bb138 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1808 microversion: 2.20 time: 0.193051 Jun 27 18:47:41.574702 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 142/297] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:41 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:42.015624 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-326dbce2-1fdb-49b3-9bf2-745afcd75d20 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:42.016255 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-326dbce2-1fdb-49b3-9bf2-745afcd75d20 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:42.022876 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-326dbce2-1fdb-49b3-9bf2-745afcd75d20 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:42.023374 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-326dbce2-1fdb-49b3-9bf2-745afcd75d20 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:42.024486 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-326dbce2-1fdb-49b3-9bf2-745afcd75d20 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:42.025288 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-326dbce2-1fdb-49b3-9bf2-745afcd75d20 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:42.186354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-326dbce2-1fdb-49b3-9bf2-745afcd75d20 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:42.195892 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-326dbce2-1fdb-49b3-9bf2-745afcd75d20 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.183405 Jun 27 18:47:42.196734 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 156/298] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:42 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:42.322130 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-45dceba2-85c3-4a8f-982c-839ffd2bc271 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:42.322130 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-45dceba2-85c3-4a8f-982c-839ffd2bc271 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:42.332781 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-45dceba2-85c3-4a8f-982c-839ffd2bc271 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:42.333239 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-45dceba2-85c3-4a8f-982c-839ffd2bc271 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:42.336725 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-45dceba2-85c3-4a8f-982c-839ffd2bc271 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:42.336725 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-45dceba2-85c3-4a8f-982c-839ffd2bc271 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:42.484952 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-45dceba2-85c3-4a8f-982c-839ffd2bc271 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:42.492983 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-45dceba2-85c3-4a8f-982c-839ffd2bc271 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.175994 Jun 27 18:47:42.493876 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 143/299] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:42 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:42.592816 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-1beb6d94-f8d7-4ee3-aa74-209fbe9a9608 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:42.593429 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-1beb6d94-f8d7-4ee3-aa74-209fbe9a9608 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:42.599335 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1beb6d94-f8d7-4ee3-aa74-209fbe9a9608 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:42.599782 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1beb6d94-f8d7-4ee3-aa74-209fbe9a9608 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:42.600544 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1beb6d94-f8d7-4ee3-aa74-209fbe9a9608 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:42.600975 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1beb6d94-f8d7-4ee3-aa74-209fbe9a9608 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:42.763746 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-1beb6d94-f8d7-4ee3-aa74-209fbe9a9608 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:42.790044 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-1beb6d94-f8d7-4ee3-aa74-209fbe9a9608 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:42.798797 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-1beb6d94-f8d7-4ee3-aa74-209fbe9a9608 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:42.801597 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-1beb6d94-f8d7-4ee3-aa74-209fbe9a9608 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1808 microversion: 2.20 time: 0.211099 Jun 27 18:47:42.801597 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 157/300] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:42 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:43.215088 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-361c1526-9ba8-4599-ae72-6814f20f21fc tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:43.215748 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-361c1526-9ba8-4599-ae72-6814f20f21fc tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:43.221931 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-361c1526-9ba8-4599-ae72-6814f20f21fc tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:43.222571 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-361c1526-9ba8-4599-ae72-6814f20f21fc tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:43.223198 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-361c1526-9ba8-4599-ae72-6814f20f21fc tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:43.223630 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-361c1526-9ba8-4599-ae72-6814f20f21fc tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:43.385266 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-361c1526-9ba8-4599-ae72-6814f20f21fc tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:43.402981 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-361c1526-9ba8-4599-ae72-6814f20f21fc tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.191399 Jun 27 18:47:43.404488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 144/301] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:43 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:43.509685 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-61187ccd-fde2-4b12-8dbc-d450277c6395 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:43.510300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-61187ccd-fde2-4b12-8dbc-d450277c6395 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:43.521338 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-61187ccd-fde2-4b12-8dbc-d450277c6395 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:43.521338 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-61187ccd-fde2-4b12-8dbc-d450277c6395 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:43.521338 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-61187ccd-fde2-4b12-8dbc-d450277c6395 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:43.521338 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-61187ccd-fde2-4b12-8dbc-d450277c6395 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:43.705875 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-61187ccd-fde2-4b12-8dbc-d450277c6395 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:43.714771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-61187ccd-fde2-4b12-8dbc-d450277c6395 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.209490 Jun 27 18:47:43.715837 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 158/302] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:43 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:43.818321 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-8e2c8264-ce3b-4e19-af2b-a1f6ec4c18d5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:43.819011 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-8e2c8264-ce3b-4e19-af2b-a1f6ec4c18d5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:43.827036 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8e2c8264-ce3b-4e19-af2b-a1f6ec4c18d5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:43.827853 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8e2c8264-ce3b-4e19-af2b-a1f6ec4c18d5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:43.828857 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8e2c8264-ce3b-4e19-af2b-a1f6ec4c18d5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:43.829503 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8e2c8264-ce3b-4e19-af2b-a1f6ec4c18d5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:43.985851 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-8e2c8264-ce3b-4e19-af2b-a1f6ec4c18d5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:44.002214 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-8e2c8264-ce3b-4e19-af2b-a1f6ec4c18d5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:44.004045 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-8e2c8264-ce3b-4e19-af2b-a1f6ec4c18d5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:44.005464 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-8e2c8264-ce3b-4e19-af2b-a1f6ec4c18d5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1808 microversion: 2.20 time: 0.191021 Jun 27 18:47:44.006722 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 145/303] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:43 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:44.424010 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-d8aacd2f-f250-4854-b8de-99ec412f6fa2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:44.425198 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-d8aacd2f-f250-4854-b8de-99ec412f6fa2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:44.433451 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d8aacd2f-f250-4854-b8de-99ec412f6fa2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:44.434242 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d8aacd2f-f250-4854-b8de-99ec412f6fa2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:44.435273 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d8aacd2f-f250-4854-b8de-99ec412f6fa2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:44.435955 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d8aacd2f-f250-4854-b8de-99ec412f6fa2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:44.580039 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-d8aacd2f-f250-4854-b8de-99ec412f6fa2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:44.589591 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-d8aacd2f-f250-4854-b8de-99ec412f6fa2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.171619 Jun 27 18:47:44.590156 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 159/304] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:44 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:44.732530 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-c36fde00-9f20-4cb6-a338-837bd6e50ae5 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:44.740538 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-c36fde00-9f20-4cb6-a338-837bd6e50ae5 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:44.760869 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c36fde00-9f20-4cb6-a338-837bd6e50ae5 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:44.761607 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c36fde00-9f20-4cb6-a338-837bd6e50ae5 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:44.762644 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c36fde00-9f20-4cb6-a338-837bd6e50ae5 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:44.764880 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c36fde00-9f20-4cb6-a338-837bd6e50ae5 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:44.978696 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-c36fde00-9f20-4cb6-a338-837bd6e50ae5 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:44.990062 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-c36fde00-9f20-4cb6-a338-837bd6e50ae5 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.261765 Jun 27 18:47:45.000520 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 146/305] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:44 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:45.029785 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-8dd9c548-e5db-475f-a182-710019b0de1e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:45.029785 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-8dd9c548-e5db-475f-a182-710019b0de1e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:45.036881 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8dd9c548-e5db-475f-a182-710019b0de1e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:45.037344 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8dd9c548-e5db-475f-a182-710019b0de1e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:45.038357 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8dd9c548-e5db-475f-a182-710019b0de1e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:45.038850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8dd9c548-e5db-475f-a182-710019b0de1e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:45.294688 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-8dd9c548-e5db-475f-a182-710019b0de1e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:45.301361 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-8dd9c548-e5db-475f-a182-710019b0de1e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:45.303013 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-8dd9c548-e5db-475f-a182-710019b0de1e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:45.304855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-8dd9c548-e5db-475f-a182-710019b0de1e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1808 microversion: 2.20 time: 0.283128 Jun 27 18:47:45.305438 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 160/306] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:45 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1808 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:45.610030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-4b53cc39-e81c-4e22-9cb2-5e276e986653 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:45.612647 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-4b53cc39-e81c-4e22-9cb2-5e276e986653 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:45.620949 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4b53cc39-e81c-4e22-9cb2-5e276e986653 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:45.621421 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4b53cc39-e81c-4e22-9cb2-5e276e986653 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:45.622207 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4b53cc39-e81c-4e22-9cb2-5e276e986653 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:45.622661 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4b53cc39-e81c-4e22-9cb2-5e276e986653 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:45.811818 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-4b53cc39-e81c-4e22-9cb2-5e276e986653 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:45.824576 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-4b53cc39-e81c-4e22-9cb2-5e276e986653 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.220048 Jun 27 18:47:45.837992 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 147/307] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:45 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:46.010440 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-573ff01a-a3af-43f6-b86c-18fca80a288c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:46.011902 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-573ff01a-a3af-43f6-b86c-18fca80a288c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:46.022427 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-573ff01a-a3af-43f6-b86c-18fca80a288c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:46.026947 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-573ff01a-a3af-43f6-b86c-18fca80a288c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:46.026947 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-573ff01a-a3af-43f6-b86c-18fca80a288c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:46.026947 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-573ff01a-a3af-43f6-b86c-18fca80a288c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:46.235146 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-573ff01a-a3af-43f6-b86c-18fca80a288c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:46.255602 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-573ff01a-a3af-43f6-b86c-18fca80a288c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.239749 Jun 27 18:47:46.255602 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 161/308] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:46 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:46.325930 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-d2f65149-4992-4ee3-a024-869f48c1f9b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:46.327939 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-d2f65149-4992-4ee3-a024-869f48c1f9b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:46.348670 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d2f65149-4992-4ee3-a024-869f48c1f9b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:46.349144 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d2f65149-4992-4ee3-a024-869f48c1f9b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:46.349956 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d2f65149-4992-4ee3-a024-869f48c1f9b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:46.350420 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d2f65149-4992-4ee3-a024-869f48c1f9b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:46.550112 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-d2f65149-4992-4ee3-a024-869f48c1f9b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:46.559813 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-d2f65149-4992-4ee3-a024-869f48c1f9b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:46.561391 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-d2f65149-4992-4ee3-a024-869f48c1f9b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:46.563089 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-d2f65149-4992-4ee3-a024-869f48c1f9b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1808 microversion: 2.20 time: 0.241622 Jun 27 18:47:46.574416 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 148/309] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:46 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1808 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:46.842367 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-47dd9538-1188-47f4-814b-981f4d72063d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:46.843147 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-47dd9538-1188-47f4-814b-981f4d72063d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:46.857836 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-47dd9538-1188-47f4-814b-981f4d72063d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:46.861222 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-47dd9538-1188-47f4-814b-981f4d72063d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:46.863172 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-47dd9538-1188-47f4-814b-981f4d72063d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:46.870133 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-47dd9538-1188-47f4-814b-981f4d72063d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:47.103632 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-47dd9538-1188-47f4-814b-981f4d72063d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:47.123354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-47dd9538-1188-47f4-814b-981f4d72063d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.285034 Jun 27 18:47:47.124416 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 162/310] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:46 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:47.266435 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-3a8f584d-1b0d-489a-a729-538eec56db5e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:47.267472 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-3a8f584d-1b0d-489a-a729-538eec56db5e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:47.281504 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3a8f584d-1b0d-489a-a729-538eec56db5e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:47.282049 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3a8f584d-1b0d-489a-a729-538eec56db5e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:47.292165 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3a8f584d-1b0d-489a-a729-538eec56db5e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:47.292165 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3a8f584d-1b0d-489a-a729-538eec56db5e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:47.526069 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-3a8f584d-1b0d-489a-a729-538eec56db5e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:47.541862 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-3a8f584d-1b0d-489a-a729-538eec56db5e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.279440 Jun 27 18:47:47.552072 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 149/311] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:47 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:47.583641 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-cacb7a7b-8cb3-419d-aaa6-d1ca1194cc19 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:47.584424 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-cacb7a7b-8cb3-419d-aaa6-d1ca1194cc19 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:47.610573 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cacb7a7b-8cb3-419d-aaa6-d1ca1194cc19 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:47.611027 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cacb7a7b-8cb3-419d-aaa6-d1ca1194cc19 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:47.614680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cacb7a7b-8cb3-419d-aaa6-d1ca1194cc19 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:47.615333 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cacb7a7b-8cb3-419d-aaa6-d1ca1194cc19 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:47.890975 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-cacb7a7b-8cb3-419d-aaa6-d1ca1194cc19 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:47.903902 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-cacb7a7b-8cb3-419d-aaa6-d1ca1194cc19 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:47.905831 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-cacb7a7b-8cb3-419d-aaa6-d1ca1194cc19 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:47.907147 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-cacb7a7b-8cb3-419d-aaa6-d1ca1194cc19 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1808 microversion: 2.20 time: 0.327828 Jun 27 18:47:47.908143 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 163/312] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:47 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1808 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:48.141730 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-5727c951-cd61-40a4-bdb5-f55f9c7a797e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:48.142630 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-5727c951-cd61-40a4-bdb5-f55f9c7a797e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:48.151265 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5727c951-cd61-40a4-bdb5-f55f9c7a797e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:48.151716 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5727c951-cd61-40a4-bdb5-f55f9c7a797e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:48.152496 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5727c951-cd61-40a4-bdb5-f55f9c7a797e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:48.152946 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5727c951-cd61-40a4-bdb5-f55f9c7a797e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:48.345762 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-5727c951-cd61-40a4-bdb5-f55f9c7a797e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:48.359209 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-5727c951-cd61-40a4-bdb5-f55f9c7a797e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.222289 Jun 27 18:47:48.360152 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 150/313] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:48 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:48.562570 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-503849eb-7198-45c6-82a8-8f7235f1a8ad tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:48.563131 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-503849eb-7198-45c6-82a8-8f7235f1a8ad tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:48.575796 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-503849eb-7198-45c6-82a8-8f7235f1a8ad tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:48.577584 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-503849eb-7198-45c6-82a8-8f7235f1a8ad tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:48.578631 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-503849eb-7198-45c6-82a8-8f7235f1a8ad tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:48.579234 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-503849eb-7198-45c6-82a8-8f7235f1a8ad tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:48.806512 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-503849eb-7198-45c6-82a8-8f7235f1a8ad tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:48.817684 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-503849eb-7198-45c6-82a8-8f7235f1a8ad tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.259586 Jun 27 18:47:48.819193 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 164/314] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:48 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:48.927415 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-33163fdd-7c72-4c7f-a55c-f9aedee9e0be tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:48.929624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-33163fdd-7c72-4c7f-a55c-f9aedee9e0be tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:48.941031 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-33163fdd-7c72-4c7f-a55c-f9aedee9e0be tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:48.941874 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-33163fdd-7c72-4c7f-a55c-f9aedee9e0be tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:48.942912 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-33163fdd-7c72-4c7f-a55c-f9aedee9e0be tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:48.943544 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-33163fdd-7c72-4c7f-a55c-f9aedee9e0be tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:49.189114 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-33163fdd-7c72-4c7f-a55c-f9aedee9e0be tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:49.204240 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-33163fdd-7c72-4c7f-a55c-f9aedee9e0be tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:49.206573 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-33163fdd-7c72-4c7f-a55c-f9aedee9e0be tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:49.210219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-33163fdd-7c72-4c7f-a55c-f9aedee9e0be tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1808 microversion: 2.20 time: 0.285497 Jun 27 18:47:49.210219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 151/315] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:48 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1808 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:49.377641 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-c1b290a0-c681-45be-ac96-4d70d4de4422 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:49.378698 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-c1b290a0-c681-45be-ac96-4d70d4de4422 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:49.387640 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c1b290a0-c681-45be-ac96-4d70d4de4422 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:49.388876 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c1b290a0-c681-45be-ac96-4d70d4de4422 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:49.389662 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c1b290a0-c681-45be-ac96-4d70d4de4422 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:49.390166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c1b290a0-c681-45be-ac96-4d70d4de4422 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:49.606784 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c1b290a0-c681-45be-ac96-4d70d4de4422 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:49.614932 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-c1b290a0-c681-45be-ac96-4d70d4de4422 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.241556 Jun 27 18:47:49.615754 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 165/316] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:49 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:49.835211 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0981e73b-10d7-45bd-b49a-a9fabc740127 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:49.836051 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-0981e73b-10d7-45bd-b49a-a9fabc740127 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:49.843254 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0981e73b-10d7-45bd-b49a-a9fabc740127 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:49.843873 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0981e73b-10d7-45bd-b49a-a9fabc740127 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:49.844793 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0981e73b-10d7-45bd-b49a-a9fabc740127 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:49.845324 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0981e73b-10d7-45bd-b49a-a9fabc740127 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:50.016193 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-0981e73b-10d7-45bd-b49a-a9fabc740127 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:50.025031 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-0981e73b-10d7-45bd-b49a-a9fabc740127 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.193626 Jun 27 18:47:50.025744 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 152/317] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:49 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:50.227420 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-fb995c94-f880-412b-aba9-e7a21ef28c16 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:50.228162 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-fb995c94-f880-412b-aba9-e7a21ef28c16 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:50.234593 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fb995c94-f880-412b-aba9-e7a21ef28c16 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:50.235044 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fb995c94-f880-412b-aba9-e7a21ef28c16 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:50.239739 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fb995c94-f880-412b-aba9-e7a21ef28c16 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:50.239739 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fb995c94-f880-412b-aba9-e7a21ef28c16 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:50.384588 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-fb995c94-f880-412b-aba9-e7a21ef28c16 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:50.394910 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-fb995c94-f880-412b-aba9-e7a21ef28c16 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:50.396556 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-fb995c94-f880-412b-aba9-e7a21ef28c16 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:50.398581 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-fb995c94-f880-412b-aba9-e7a21ef28c16 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1808 microversion: 2.20 time: 0.175132 Jun 27 18:47:50.399802 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 166/318] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:50 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:50.633260 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-8ec1206a-03c5-4245-817b-fecb38afee98 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:50.634003 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-8ec1206a-03c5-4245-817b-fecb38afee98 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:50.640589 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8ec1206a-03c5-4245-817b-fecb38afee98 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:50.641044 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8ec1206a-03c5-4245-817b-fecb38afee98 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:50.641921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8ec1206a-03c5-4245-817b-fecb38afee98 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:50.642586 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8ec1206a-03c5-4245-817b-fecb38afee98 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:50.817196 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-8ec1206a-03c5-4245-817b-fecb38afee98 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:50.829461 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-8ec1206a-03c5-4245-817b-fecb38afee98 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1699 microversion: 2.1 time: 0.197398 Jun 27 18:47:50.829461 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 153/319] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:50 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1699 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:50.847374 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-cb793996-5045-46b1-b304-8a6ef41fe204 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:47:50.856064 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cb793996-5045-46b1-b304-8a6ef41fe204 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:50.856518 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cb793996-5045-46b1-b304-8a6ef41fe204 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:50.922260 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-cb793996-5045-46b1-b304-8a6ef41fe204 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Going to try to start instance {{(pid=124716) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 27 18:47:50.937664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=100 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:47:51.041409 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a14330e2-dea3-4ae8-b8f1-5c8829342e8c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:51.042023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-a14330e2-dea3-4ae8-b8f1-5c8829342e8c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:51.048472 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a14330e2-dea3-4ae8-b8f1-5c8829342e8c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:51.048920 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a14330e2-dea3-4ae8-b8f1-5c8829342e8c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:51.049677 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a14330e2-dea3-4ae8-b8f1-5c8829342e8c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:51.050108 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a14330e2-dea3-4ae8-b8f1-5c8829342e8c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:51.174415 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-cb793996-5045-46b1-b304-8a6ef41fe204 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "POST /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91/action" status: 202 len: 0 microversion: 2.1 time: 0.332264 Jun 27 18:47:51.175200 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 167/320] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Jun 27 18:47:50 2022] POST /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:47:51.181963 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-11476ea9-d0d5-4f01-84de-8171e6fa733e tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-675401601", "imageRef": "c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3", "flavorRef": "452", "networks": [{"uuid": "2f27c706-4564-442e-9b2f-a29bbaaf6698"}]}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:47:51.202837 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a14330e2-dea3-4ae8-b8f1-5c8829342e8c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:51.205018 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=100 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:47:51.213082 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-a14330e2-dea3-4ae8-b8f1-5c8829342e8c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.175320 Jun 27 18:47:51.213339 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 154/321] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:51 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:51.218042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-d9b20128-1396-432e-acd9-c57bb3238403 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:51.218832 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-d9b20128-1396-432e-acd9-c57bb3238403 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:51.225248 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d9b20128-1396-432e-acd9-c57bb3238403 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:51.225812 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d9b20128-1396-432e-acd9-c57bb3238403 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:51.226699 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d9b20128-1396-432e-acd9-c57bb3238403 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:51.227366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d9b20128-1396-432e-acd9-c57bb3238403 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:51.260657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.network.neutron [None req-11476ea9-d0d5-4f01-84de-8171e6fa733e tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] validate_networks() for [('2f27c706-4564-442e-9b2f-a29bbaaf6698', None, None, None, None, None)] {{(pid=124716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 18:47:51.512279 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-d9b20128-1396-432e-acd9-c57bb3238403 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:51.520568 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-d9b20128-1396-432e-acd9-c57bb3238403 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1708 microversion: 2.1 time: 0.306164 Jun 27 18:47:51.521939 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 155/322] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:51 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1708 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:51.527296 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-609d75ef-8d5c-48de-9bee-6c2833f4c29c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:51.528290 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-609d75ef-8d5c-48de-9bee-6c2833f4c29c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:51.534687 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-609d75ef-8d5c-48de-9bee-6c2833f4c29c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:51.535289 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-609d75ef-8d5c-48de-9bee-6c2833f4c29c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:51.536815 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-609d75ef-8d5c-48de-9bee-6c2833f4c29c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:51.537249 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-609d75ef-8d5c-48de-9bee-6c2833f4c29c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:52.074262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-609d75ef-8d5c-48de-9bee-6c2833f4c29c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:52.083593 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-609d75ef-8d5c-48de-9bee-6c2833f4c29c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:52.088192 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-609d75ef-8d5c-48de-9bee-6c2833f4c29c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:52.088192 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-609d75ef-8d5c-48de-9bee-6c2833f4c29c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1808 microversion: 2.20 time: 0.563300 Jun 27 18:47:52.088192 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 156/323] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:51 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1808 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:52.213797 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-11476ea9-d0d5-4f01-84de-8171e6fa733e tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Flavor limits 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 18:47:52.214292 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-11476ea9-d0d5-4f01-84de-8171e6fa733e tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Image limits 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 18:47:52.216244 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-11476ea9-d0d5-4f01-84de-8171e6fa733e tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Flavor pref 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 18:47:52.216244 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-11476ea9-d0d5-4f01-84de-8171e6fa733e tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Image pref 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 18:47:52.216244 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-11476ea9-d0d5-4f01-84de-8171e6fa733e tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 18:47:52.226984 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-11476ea9-d0d5-4f01-84de-8171e6fa733e tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:52.227440 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-11476ea9-d0d5-4f01-84de-8171e6fa733e tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:52.228276 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-11476ea9-d0d5-4f01-84de-8171e6fa733e tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:52.228907 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-11476ea9-d0d5-4f01-84de-8171e6fa733e tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:52.232778 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-12736611-0c73-4c68-b39e-f043c014aaf0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:52.233474 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-12736611-0c73-4c68-b39e-f043c014aaf0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:52.239974 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-12736611-0c73-4c68-b39e-f043c014aaf0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:52.244965 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-12736611-0c73-4c68-b39e-f043c014aaf0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:52.244965 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-12736611-0c73-4c68-b39e-f043c014aaf0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:52.244965 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-12736611-0c73-4c68-b39e-f043c014aaf0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:52.252174 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-11476ea9-d0d5-4f01-84de-8171e6fa733e tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Getting quotas for project 5284ec5970e14418bfbd5391ee3b282c. Resources: {'ram', 'cores', 'instances'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:47:52.256968 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-11476ea9-d0d5-4f01-84de-8171e6fa733e tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Getting quotas for user f5f17909688f40f9b752e63b4074c2ee and project 5284ec5970e14418bfbd5391ee3b282c. Resources: {'ram', 'cores', 'instances'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:47:52.269925 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-11476ea9-d0d5-4f01-84de-8171e6fa733e tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Going to run 1 instances... {{(pid=124716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 18:47:52.272611 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-11476ea9-d0d5-4f01-84de-8171e6fa733e tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 18:47:52.418708 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-11476ea9-d0d5-4f01-84de-8171e6fa733e tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.241677 Jun 27 18:47:52.419777 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 168/324] 10.222.0.15 () {60 vars in 1146 bytes} [Mon Jun 27 18:47:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 18:47:52.432812 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-d430d8e1-4ffb-40d0-8b99-54f0ad210938 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:52.435381 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-d430d8e1-4ffb-40d0-8b99-54f0ad210938 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:52.469956 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-12736611-0c73-4c68-b39e-f043c014aaf0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:52.486127 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-12736611-0c73-4c68-b39e-f043c014aaf0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.257032 Jun 27 18:47:52.495195 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 157/325] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:52 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:52.538554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-d430d8e1-4ffb-40d0-8b99-54f0ad210938 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:52.542279 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-924ba4c6-c946-4127-8ab7-5c10e1035f12 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:52.542279 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-924ba4c6-c946-4127-8ab7-5c10e1035f12 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:52.552880 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-d430d8e1-4ffb-40d0-8b99-54f0ad210938 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831" status: 200 len: 1218 microversion: 2.1 time: 0.127315 Jun 27 18:47:52.553501 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 169/326] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:52 2022] GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831 => generated 1218 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:52.553968 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-924ba4c6-c946-4127-8ab7-5c10e1035f12 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:52.554590 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-924ba4c6-c946-4127-8ab7-5c10e1035f12 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:52.560711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-924ba4c6-c946-4127-8ab7-5c10e1035f12 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:52.560711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-924ba4c6-c946-4127-8ab7-5c10e1035f12 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:52.723906 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-924ba4c6-c946-4127-8ab7-5c10e1035f12 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:52.732635 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-924ba4c6-c946-4127-8ab7-5c10e1035f12 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1708 microversion: 2.1 time: 0.195511 Jun 27 18:47:52.733227 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 158/327] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:52 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1708 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:53.105777 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-b3832231-f855-406c-b920-4d5ea07c6a16 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:53.106555 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-b3832231-f855-406c-b920-4d5ea07c6a16 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:53.113666 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b3832231-f855-406c-b920-4d5ea07c6a16 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:53.114115 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b3832231-f855-406c-b920-4d5ea07c6a16 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:53.114922 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b3832231-f855-406c-b920-4d5ea07c6a16 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:53.115362 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b3832231-f855-406c-b920-4d5ea07c6a16 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:53.253284 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-b3832231-f855-406c-b920-4d5ea07c6a16 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:53.262029 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-b3832231-f855-406c-b920-4d5ea07c6a16 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:53.263848 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-b3832231-f855-406c-b920-4d5ea07c6a16 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:53.264955 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-b3832231-f855-406c-b920-4d5ea07c6a16 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1808 microversion: 2.20 time: 0.164198 Jun 27 18:47:53.265438 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 170/328] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:53 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:47:53.505641 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-2b33b3ea-7964-44a1-80b9-1fd60fdd5054 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:53.506263 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-2b33b3ea-7964-44a1-80b9-1fd60fdd5054 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:53.513817 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2b33b3ea-7964-44a1-80b9-1fd60fdd5054 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:53.514291 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2b33b3ea-7964-44a1-80b9-1fd60fdd5054 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:53.515173 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2b33b3ea-7964-44a1-80b9-1fd60fdd5054 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:53.515842 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2b33b3ea-7964-44a1-80b9-1fd60fdd5054 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:53.575286 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-b660f7fc-8453-4fa0-a286-8da27148bac2 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:53.576321 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-b660f7fc-8453-4fa0-a286-8da27148bac2 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:53.658645 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-b660f7fc-8453-4fa0-a286-8da27148bac2 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:53.667730 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-b660f7fc-8453-4fa0-a286-8da27148bac2 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831" status: 200 len: 1218 microversion: 2.1 time: 0.096300 Jun 27 18:47:53.677413 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 171/329] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:53 2022] GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:53.700204 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-2b33b3ea-7964-44a1-80b9-1fd60fdd5054 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:53.710151 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-2b33b3ea-7964-44a1-80b9-1fd60fdd5054 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.209150 Jun 27 18:47:53.720611 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 159/330] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:53 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:53.757733 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-85d9ed63-f3a7-44d0-b010-38749b29623c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:53.759132 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-85d9ed63-f3a7-44d0-b010-38749b29623c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:53.768006 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-85d9ed63-f3a7-44d0-b010-38749b29623c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:53.768485 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-85d9ed63-f3a7-44d0-b010-38749b29623c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:53.769268 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-85d9ed63-f3a7-44d0-b010-38749b29623c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:53.769700 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-85d9ed63-f3a7-44d0-b010-38749b29623c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:53.916438 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-85d9ed63-f3a7-44d0-b010-38749b29623c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:53.925549 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-85d9ed63-f3a7-44d0-b010-38749b29623c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1708 microversion: 2.1 time: 0.172736 Jun 27 18:47:53.926189 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 172/331] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:53 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1708 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:54.282710 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-1bd07e88-975c-4240-829a-85bf9d9b13d1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:54.283245 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-1bd07e88-975c-4240-829a-85bf9d9b13d1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:54.290046 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1bd07e88-975c-4240-829a-85bf9d9b13d1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:54.292747 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1bd07e88-975c-4240-829a-85bf9d9b13d1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:54.292747 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1bd07e88-975c-4240-829a-85bf9d9b13d1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:54.292747 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1bd07e88-975c-4240-829a-85bf9d9b13d1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:54.428585 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-1bd07e88-975c-4240-829a-85bf9d9b13d1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:54.438159 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-1bd07e88-975c-4240-829a-85bf9d9b13d1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:54.439713 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-1bd07e88-975c-4240-829a-85bf9d9b13d1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:54.440906 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-1bd07e88-975c-4240-829a-85bf9d9b13d1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1808 microversion: 2.20 time: 0.162299 Jun 27 18:47:54.441456 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 160/332] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:54 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:54.685851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f0c8b6b6-117b-4b6e-8461-24af7336a2e9 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:54.686539 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f0c8b6b6-117b-4b6e-8461-24af7336a2e9 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:54.692545 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f0c8b6b6-117b-4b6e-8461-24af7336a2e9 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:54.692989 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f0c8b6b6-117b-4b6e-8461-24af7336a2e9 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:54.693744 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f0c8b6b6-117b-4b6e-8461-24af7336a2e9 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:54.694172 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f0c8b6b6-117b-4b6e-8461-24af7336a2e9 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:54.728371 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-954f22f3-2417-4366-a619-f9a0f91d80b9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:54.728987 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-954f22f3-2417-4366-a619-f9a0f91d80b9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:54.739499 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-954f22f3-2417-4366-a619-f9a0f91d80b9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:54.744914 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-954f22f3-2417-4366-a619-f9a0f91d80b9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:54.744914 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-954f22f3-2417-4366-a619-f9a0f91d80b9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:54.744914 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-954f22f3-2417-4366-a619-f9a0f91d80b9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:54.762779 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f0c8b6b6-117b-4b6e-8461-24af7336a2e9 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:54.776658 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f0c8b6b6-117b-4b6e-8461-24af7336a2e9 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831" status: 200 len: 1270 microversion: 2.1 time: 0.094648 Jun 27 18:47:54.777876 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 173/333] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:54 2022] GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831 => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:54.950279 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-47fff923-4311-4a45-b584-e760b0c74b15 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:54.951693 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-47fff923-4311-4a45-b584-e760b0c74b15 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:54.962619 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-47fff923-4311-4a45-b584-e760b0c74b15 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:54.963469 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-47fff923-4311-4a45-b584-e760b0c74b15 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:54.968332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-47fff923-4311-4a45-b584-e760b0c74b15 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:54.968332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-47fff923-4311-4a45-b584-e760b0c74b15 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:54.971612 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-954f22f3-2417-4366-a619-f9a0f91d80b9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:54.980158 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-954f22f3-2417-4366-a619-f9a0f91d80b9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.255894 Jun 27 18:47:54.987432 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 161/334] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:54 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:55.218425 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-47fff923-4311-4a45-b584-e760b0c74b15 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:55.228675 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-47fff923-4311-4a45-b584-e760b0c74b15 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1712 microversion: 2.1 time: 0.287658 Jun 27 18:47:55.229266 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 174/335] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:54 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1712 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:55.459935 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-6db2a80f-9434-4858-aa37-8b00cdf8efb2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:55.460660 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-6db2a80f-9434-4858-aa37-8b00cdf8efb2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:55.469842 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6db2a80f-9434-4858-aa37-8b00cdf8efb2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:55.469842 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6db2a80f-9434-4858-aa37-8b00cdf8efb2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:55.469842 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6db2a80f-9434-4858-aa37-8b00cdf8efb2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:55.470196 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6db2a80f-9434-4858-aa37-8b00cdf8efb2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:55.704054 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-6db2a80f-9434-4858-aa37-8b00cdf8efb2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:55.712697 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-6db2a80f-9434-4858-aa37-8b00cdf8efb2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:55.714297 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-6db2a80f-9434-4858-aa37-8b00cdf8efb2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:55.715494 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-6db2a80f-9434-4858-aa37-8b00cdf8efb2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1808 microversion: 2.20 time: 0.259700 Jun 27 18:47:55.716048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 162/336] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:55 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1808 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:55.793376 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-cdac6f68-670c-42d8-8e9f-dba7490624a9 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:55.793997 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-cdac6f68-670c-42d8-8e9f-dba7490624a9 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:55.800532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cdac6f68-670c-42d8-8e9f-dba7490624a9 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:55.801073 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cdac6f68-670c-42d8-8e9f-dba7490624a9 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:55.805523 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cdac6f68-670c-42d8-8e9f-dba7490624a9 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:55.805523 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cdac6f68-670c-42d8-8e9f-dba7490624a9 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:55.998091 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-400bf323-296e-4e36-9bff-95d9c7c7498d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:55.998830 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-400bf323-296e-4e36-9bff-95d9c7c7498d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:56.007609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-400bf323-296e-4e36-9bff-95d9c7c7498d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:56.008263 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-400bf323-296e-4e36-9bff-95d9c7c7498d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:56.009050 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-400bf323-296e-4e36-9bff-95d9c7c7498d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:56.009526 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-400bf323-296e-4e36-9bff-95d9c7c7498d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:56.029121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-cdac6f68-670c-42d8-8e9f-dba7490624a9 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:56.036539 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-cdac6f68-670c-42d8-8e9f-dba7490624a9 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831" status: 200 len: 1318 microversion: 2.1 time: 0.247029 Jun 27 18:47:56.037103 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 175/337] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:55 2022] GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:56.145806 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-400bf323-296e-4e36-9bff-95d9c7c7498d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:56.153573 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-400bf323-296e-4e36-9bff-95d9c7c7498d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.159768 Jun 27 18:47:56.154135 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 163/338] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:55 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:56.735478 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-92e4c938-f7e8-4af1-8b2d-8514aa4665a3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:56.736018 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-92e4c938-f7e8-4af1-8b2d-8514aa4665a3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:56.742965 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-92e4c938-f7e8-4af1-8b2d-8514aa4665a3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:56.743477 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-92e4c938-f7e8-4af1-8b2d-8514aa4665a3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:56.744250 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-92e4c938-f7e8-4af1-8b2d-8514aa4665a3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:56.744682 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-92e4c938-f7e8-4af1-8b2d-8514aa4665a3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:56.880586 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-92e4c938-f7e8-4af1-8b2d-8514aa4665a3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:56.890594 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-92e4c938-f7e8-4af1-8b2d-8514aa4665a3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:56.892482 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-92e4c938-f7e8-4af1-8b2d-8514aa4665a3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:56.893926 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-92e4c938-f7e8-4af1-8b2d-8514aa4665a3 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1808 microversion: 2.20 time: 0.162694 Jun 27 18:47:56.894799 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 176/339] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:56 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:57.059233 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-9ed82bcf-6aef-4186-a21c-7a06ebfb94f3 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:57.059852 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-9ed82bcf-6aef-4186-a21c-7a06ebfb94f3 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:57.066866 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9ed82bcf-6aef-4186-a21c-7a06ebfb94f3 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:57.067321 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9ed82bcf-6aef-4186-a21c-7a06ebfb94f3 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:57.068100 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9ed82bcf-6aef-4186-a21c-7a06ebfb94f3 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:57.068533 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9ed82bcf-6aef-4186-a21c-7a06ebfb94f3 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:57.171066 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-2dd4a21d-7e83-451f-93d3-49ee7e35f040 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:57.171796 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-2dd4a21d-7e83-451f-93d3-49ee7e35f040 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:57.174146 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:47:57.180124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2dd4a21d-7e83-451f-93d3-49ee7e35f040 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:57.180638 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2dd4a21d-7e83-451f-93d3-49ee7e35f040 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:57.181572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2dd4a21d-7e83-451f-93d3-49ee7e35f040 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:57.182027 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2dd4a21d-7e83-451f-93d3-49ee7e35f040 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:57.371161 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-9ed82bcf-6aef-4186-a21c-7a06ebfb94f3 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:57.379322 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-9ed82bcf-6aef-4186-a21c-7a06ebfb94f3 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831" status: 200 len: 1318 microversion: 2.1 time: 0.324554 Jun 27 18:47:57.379807 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 164/340] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:57 2022] GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:57.427478 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-2dd4a21d-7e83-451f-93d3-49ee7e35f040 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:57.436223 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-2dd4a21d-7e83-451f-93d3-49ee7e35f040 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.268977 Jun 27 18:47:57.436793 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 177/341] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:57 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:57.889152 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-e7715c8a-71b1-4bd3-a9af-efb193bd35be req-5f73e33b-f7e8-4faa-adf8-506b6c29ac09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab81efbc-7e62-4405-a45a-5d8448895831", "tag": "9e4f60d5-1a7d-41b7-903c-ffe073243353"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:47:57.893888 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_api:SELECT=82 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:47:57.897867 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-e7715c8a-71b1-4bd3-a9af-efb193bd35be req-5f73e33b-f7e8-4faa-adf8-506b6c29ac09 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:57.898918 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-e7715c8a-71b1-4bd3-a9af-efb193bd35be req-5f73e33b-f7e8-4faa-adf8-506b6c29ac09 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:57.910353 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-e7715c8a-71b1-4bd3-a9af-efb193bd35be req-5f73e33b-f7e8-4faa-adf8-506b6c29ac09 service nova] Creating event network-changed:9e4f60d5-1a7d-41b7-903c-ffe073243353 for instance ab81efbc-7e62-4405-a45a-5d8448895831 on hv-cinder-84460 Jun 27 18:47:57.913726 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-94eb2dbe-4ebc-4f12-8e35-d01434036ba2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:57.915619 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-94eb2dbe-4ebc-4f12-8e35-d01434036ba2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:57.916775 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-e7715c8a-71b1-4bd3-a9af-efb193bd35be req-5f73e33b-f7e8-4faa-adf8-506b6c29ac09 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031686 Jun 27 18:47:57.917409 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 165/342] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:47:57.921854 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-94eb2dbe-4ebc-4f12-8e35-d01434036ba2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:57.922396 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-94eb2dbe-4ebc-4f12-8e35-d01434036ba2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:57.923169 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-94eb2dbe-4ebc-4f12-8e35-d01434036ba2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:57.923814 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-94eb2dbe-4ebc-4f12-8e35-d01434036ba2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:58.167005 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-94eb2dbe-4ebc-4f12-8e35-d01434036ba2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:58.175738 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-94eb2dbe-4ebc-4f12-8e35-d01434036ba2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:58.177226 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-94eb2dbe-4ebc-4f12-8e35-d01434036ba2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:58.178399 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-94eb2dbe-4ebc-4f12-8e35-d01434036ba2 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1808 microversion: 2.20 time: 0.269374 Jun 27 18:47:58.178954 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 178/343] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:57 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1808 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:58.396402 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-c51e30d4-2cc8-4dd1-bb68-d1948391ddc1 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:58.397179 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-c51e30d4-2cc8-4dd1-bb68-d1948391ddc1 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:58.405875 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c51e30d4-2cc8-4dd1-bb68-d1948391ddc1 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:58.406334 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c51e30d4-2cc8-4dd1-bb68-d1948391ddc1 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:58.407165 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c51e30d4-2cc8-4dd1-bb68-d1948391ddc1 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:58.407608 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c51e30d4-2cc8-4dd1-bb68-d1948391ddc1 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:58.454934 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-29f1229d-237d-4d91-aeb7-cbc0ffa50a24 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:58.455547 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-29f1229d-237d-4d91-aeb7-cbc0ffa50a24 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:58.463473 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-29f1229d-237d-4d91-aeb7-cbc0ffa50a24 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:58.464177 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-29f1229d-237d-4d91-aeb7-cbc0ffa50a24 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:58.464954 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-29f1229d-237d-4d91-aeb7-cbc0ffa50a24 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:58.465388 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-29f1229d-237d-4d91-aeb7-cbc0ffa50a24 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:58.675264 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-c51e30d4-2cc8-4dd1-bb68-d1948391ddc1 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:58.683649 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-c51e30d4-2cc8-4dd1-bb68-d1948391ddc1 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831" status: 200 len: 1318 microversion: 2.1 time: 0.291444 Jun 27 18:47:58.684251 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 166/344] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:58 2022] GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831 => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:58.740160 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-29f1229d-237d-4d91-aeb7-cbc0ffa50a24 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:58.749884 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-29f1229d-237d-4d91-aeb7-cbc0ffa50a24 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.298887 Jun 27 18:47:58.750477 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 179/345] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:58 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:47:59.196991 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-1ec43b34-e18b-4983-9c88-bb96b256a0db tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:59.197625 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-1ec43b34-e18b-4983-9c88-bb96b256a0db tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:59.203758 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1ec43b34-e18b-4983-9c88-bb96b256a0db tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:59.204187 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1ec43b34-e18b-4983-9c88-bb96b256a0db tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:59.204952 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1ec43b34-e18b-4983-9c88-bb96b256a0db tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:59.205385 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1ec43b34-e18b-4983-9c88-bb96b256a0db tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:59.341654 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-1ec43b34-e18b-4983-9c88-bb96b256a0db tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:59.350002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-1ec43b34-e18b-4983-9c88-bb96b256a0db tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:59.352260 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-1ec43b34-e18b-4983-9c88-bb96b256a0db tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:59.353416 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-1ec43b34-e18b-4983-9c88-bb96b256a0db tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1808 microversion: 2.20 time: 0.160876 Jun 27 18:47:59.353961 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 167/346] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:47:59 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:47:59.701057 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-12861add-a2f0-4935-bf3c-33a42fc7bc84 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:59.701678 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-12861add-a2f0-4935-bf3c-33a42fc7bc84 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:59.707783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-12861add-a2f0-4935-bf3c-33a42fc7bc84 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:59.708214 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-12861add-a2f0-4935-bf3c-33a42fc7bc84 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:59.708970 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-12861add-a2f0-4935-bf3c-33a42fc7bc84 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:59.709410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-12861add-a2f0-4935-bf3c-33a42fc7bc84 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:59.767918 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-393f4ae6-654e-4768-8b46-cc69d94f8cbb tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:47:59.768530 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-393f4ae6-654e-4768-8b46-cc69d94f8cbb tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:47:59.776036 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-393f4ae6-654e-4768-8b46-cc69d94f8cbb tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:59.776480 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-393f4ae6-654e-4768-8b46-cc69d94f8cbb tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:59.777246 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-393f4ae6-654e-4768-8b46-cc69d94f8cbb tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:47:59.777855 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-393f4ae6-654e-4768-8b46-cc69d94f8cbb tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:47:59.896966 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-12861add-a2f0-4935-bf3c-33a42fc7bc84 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:59.905141 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-12861add-a2f0-4935-bf3c-33a42fc7bc84 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831" status: 200 len: 1318 microversion: 2.1 time: 0.208043 Jun 27 18:47:59.905716 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 180/347] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:59 2022] GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:47:59.940803 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-393f4ae6-654e-4768-8b46-cc69d94f8cbb tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:47:59.949011 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-393f4ae6-654e-4768-8b46-cc69d94f8cbb tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.185054 Jun 27 18:47:59.949574 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 168/348] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:47:59 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:00.372691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-2ca40370-8344-4797-84ae-cd3aa2e61243 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:00.373305 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-2ca40370-8344-4797-84ae-cd3aa2e61243 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:00.379275 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2ca40370-8344-4797-84ae-cd3aa2e61243 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:00.379725 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2ca40370-8344-4797-84ae-cd3aa2e61243 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:00.380489 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2ca40370-8344-4797-84ae-cd3aa2e61243 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:00.380930 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2ca40370-8344-4797-84ae-cd3aa2e61243 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:00.511486 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-2ca40370-8344-4797-84ae-cd3aa2e61243 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:00.519943 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-2ca40370-8344-4797-84ae-cd3aa2e61243 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:00.521579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-2ca40370-8344-4797-84ae-cd3aa2e61243 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:00.522783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-2ca40370-8344-4797-84ae-cd3aa2e61243 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1808 microversion: 2.20 time: 0.154008 Jun 27 18:48:00.523476 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 181/349] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:48:00 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:48:00.922053 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-55e38779-e9d3-4b6a-a6ee-b2cf0cf8f1fc tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:00.922704 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-55e38779-e9d3-4b6a-a6ee-b2cf0cf8f1fc tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:00.929849 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-55e38779-e9d3-4b6a-a6ee-b2cf0cf8f1fc tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:00.930912 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-55e38779-e9d3-4b6a-a6ee-b2cf0cf8f1fc tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:00.931793 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-55e38779-e9d3-4b6a-a6ee-b2cf0cf8f1fc tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:00.932235 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-55e38779-e9d3-4b6a-a6ee-b2cf0cf8f1fc tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:00.965996 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-96aa06b1-3b44-484b-bc3a-0cb90e6c4cb4 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:00.969429 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-96aa06b1-3b44-484b-bc3a-0cb90e6c4cb4 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:00.974254 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-96aa06b1-3b44-484b-bc3a-0cb90e6c4cb4 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:00.974885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-96aa06b1-3b44-484b-bc3a-0cb90e6c4cb4 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:00.975671 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-96aa06b1-3b44-484b-bc3a-0cb90e6c4cb4 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:00.976108 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-96aa06b1-3b44-484b-bc3a-0cb90e6c4cb4 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:01.156784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-55e38779-e9d3-4b6a-a6ee-b2cf0cf8f1fc tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:01.165238 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-55e38779-e9d3-4b6a-a6ee-b2cf0cf8f1fc tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831" status: 200 len: 1318 microversion: 2.1 time: 0.246378 Jun 27 18:48:01.166143 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 169/350] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:00 2022] GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:01.169179 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-96aa06b1-3b44-484b-bc3a-0cb90e6c4cb4 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:01.176807 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-96aa06b1-3b44-484b-bc3a-0cb90e6c4cb4 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.215578 Jun 27 18:48:01.177609 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 182/351] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:00 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:01.316733 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-6c6df2d5-284e-4f5b-ace8-2065c9e44d82 req-2d7c0e6a-aae9-4750-9193-43bdce780a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91366512-6fa4-4a20-a867-94852749b02f", "name": "network-vif-plugged", "status": "completed", "tag": "3ca020b2-805d-45e4-9147-1a3d32b54834"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:48:01.327027 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-6c6df2d5-284e-4f5b-ace8-2065c9e44d82 req-2d7c0e6a-aae9-4750-9193-43bdce780a95 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:01.327474 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-6c6df2d5-284e-4f5b-ace8-2065c9e44d82 req-2d7c0e6a-aae9-4750-9193-43bdce780a95 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:01.340296 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-6c6df2d5-284e-4f5b-ace8-2065c9e44d82 req-2d7c0e6a-aae9-4750-9193-43bdce780a95 service nova] Creating event network-vif-plugged:3ca020b2-805d-45e4-9147-1a3d32b54834 for instance 91366512-6fa4-4a20-a867-94852749b02f on hv-cinder-84460 Jun 27 18:48:01.345535 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-6c6df2d5-284e-4f5b-ace8-2065c9e44d82 req-2d7c0e6a-aae9-4750-9193-43bdce780a95 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033477 Jun 27 18:48:01.346341 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 170/352] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:48:01.541267 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-565703b3-4f12-4dd2-b0b8-0cca6c130edf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:01.541885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-565703b3-4f12-4dd2-b0b8-0cca6c130edf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:01.548042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-565703b3-4f12-4dd2-b0b8-0cca6c130edf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:01.548528 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-565703b3-4f12-4dd2-b0b8-0cca6c130edf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:01.549369 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-565703b3-4f12-4dd2-b0b8-0cca6c130edf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:01.549715 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-565703b3-4f12-4dd2-b0b8-0cca6c130edf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:01.681585 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-565703b3-4f12-4dd2-b0b8-0cca6c130edf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:01.690197 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-565703b3-4f12-4dd2-b0b8-0cca6c130edf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:01.691662 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-565703b3-4f12-4dd2-b0b8-0cca6c130edf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:01.692900 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-565703b3-4f12-4dd2-b0b8-0cca6c130edf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1808 microversion: 2.20 time: 0.155605 Jun 27 18:48:01.693583 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 183/353] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:48:01 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:48:02.183690 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-d6bf50e1-8662-4475-b40e-47563efd349a tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:02.184415 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-d6bf50e1-8662-4475-b40e-47563efd349a tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:02.192422 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d6bf50e1-8662-4475-b40e-47563efd349a tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:02.192944 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d6bf50e1-8662-4475-b40e-47563efd349a tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:02.193729 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d6bf50e1-8662-4475-b40e-47563efd349a tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:02.194167 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d6bf50e1-8662-4475-b40e-47563efd349a tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:02.195772 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-fd422db0-624f-499b-b266-a33117fcd8cc tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:02.196401 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-fd422db0-624f-499b-b266-a33117fcd8cc tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:02.214248 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd422db0-624f-499b-b266-a33117fcd8cc tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:02.214248 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd422db0-624f-499b-b266-a33117fcd8cc tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:02.214248 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd422db0-624f-499b-b266-a33117fcd8cc tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:02.214248 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd422db0-624f-499b-b266-a33117fcd8cc tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:02.241358 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=2 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:48:02.408287 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-d6bf50e1-8662-4475-b40e-47563efd349a tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:02.415841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-fd422db0-624f-499b-b266-a33117fcd8cc tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:02.421905 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-d6bf50e1-8662-4475-b40e-47563efd349a tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831" status: 200 len: 1318 microversion: 2.1 time: 0.244174 Jun 27 18:48:02.422528 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 171/354] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:02 2022] GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:48:02.438080 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-fd422db0-624f-499b-b266-a33117fcd8cc tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.248875 Jun 27 18:48:02.442885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 184/355] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:02 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:02.712570 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-6880c65f-f6db-47e2-9cf5-cd708964c2a5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:02.713193 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-6880c65f-f6db-47e2-9cf5-cd708964c2a5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:02.719653 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6880c65f-f6db-47e2-9cf5-cd708964c2a5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:02.720101 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6880c65f-f6db-47e2-9cf5-cd708964c2a5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:02.721104 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6880c65f-f6db-47e2-9cf5-cd708964c2a5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:02.721592 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6880c65f-f6db-47e2-9cf5-cd708964c2a5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:02.857137 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-6880c65f-f6db-47e2-9cf5-cd708964c2a5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:02.859490 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=100 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:48:02.866117 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-6880c65f-f6db-47e2-9cf5-cd708964c2a5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:02.868040 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-6880c65f-f6db-47e2-9cf5-cd708964c2a5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:02.868992 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-6880c65f-f6db-47e2-9cf5-cd708964c2a5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1808 microversion: 2.20 time: 0.161575 Jun 27 18:48:02.869543 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 172/356] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:48:02 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:48:03.439839 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-3fb91990-707d-4c9e-a850-0b43a1351dfb tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:03.441042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-3fb91990-707d-4c9e-a850-0b43a1351dfb tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:03.451330 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3fb91990-707d-4c9e-a850-0b43a1351dfb tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:03.451881 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3fb91990-707d-4c9e-a850-0b43a1351dfb tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:03.452737 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3fb91990-707d-4c9e-a850-0b43a1351dfb tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:03.453240 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3fb91990-707d-4c9e-a850-0b43a1351dfb tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:03.455121 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-cbc2f819-6385-4180-9f32-46d89f0be598 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:03.455749 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-cbc2f819-6385-4180-9f32-46d89f0be598 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:03.463229 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cbc2f819-6385-4180-9f32-46d89f0be598 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:03.465176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cbc2f819-6385-4180-9f32-46d89f0be598 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:03.468540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cbc2f819-6385-4180-9f32-46d89f0be598 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:03.469047 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cbc2f819-6385-4180-9f32-46d89f0be598 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:03.663785 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=10 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:48:03.678298 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3fb91990-707d-4c9e-a850-0b43a1351dfb tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:03.683221 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-cbc2f819-6385-4180-9f32-46d89f0be598 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:03.687106 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-3fb91990-707d-4c9e-a850-0b43a1351dfb tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831" status: 200 len: 1318 microversion: 2.1 time: 0.251220 Jun 27 18:48:03.687702 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 185/357] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:03 2022] GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:03.690944 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-cbc2f819-6385-4180-9f32-46d89f0be598 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1521 microversion: 2.1 time: 0.239630 Jun 27 18:48:03.691498 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 173/358] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:03 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:48:03.887624 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-de4c71b3-5420-4653-b961-984fff09ad60 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:03.888926 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-de4c71b3-5420-4653-b961-984fff09ad60 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:03.895242 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-de4c71b3-5420-4653-b961-984fff09ad60 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:03.895692 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-de4c71b3-5420-4653-b961-984fff09ad60 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:03.896458 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-de4c71b3-5420-4653-b961-984fff09ad60 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:03.896890 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-de4c71b3-5420-4653-b961-984fff09ad60 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:03.913357 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:48:04.054563 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-de4c71b3-5420-4653-b961-984fff09ad60 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:04.060871 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-de4c71b3-5420-4653-b961-984fff09ad60 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:04.062506 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-de4c71b3-5420-4653-b961-984fff09ad60 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:04.063891 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-de4c71b3-5420-4653-b961-984fff09ad60 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1808 microversion: 2.20 time: 0.180888 Jun 27 18:48:04.064445 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 186/359] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:48:03 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:48:04.704004 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-d9875b43-283f-41fb-a402-d61c85d4fe60 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:04.704797 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-d9875b43-283f-41fb-a402-d61c85d4fe60 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:04.708341 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-9e0ce652-5fee-40c2-a732-893052be8b3f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:04.708990 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-9e0ce652-5fee-40c2-a732-893052be8b3f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:04.712048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d9875b43-283f-41fb-a402-d61c85d4fe60 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:04.712699 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d9875b43-283f-41fb-a402-d61c85d4fe60 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:04.713479 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d9875b43-283f-41fb-a402-d61c85d4fe60 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:04.713951 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d9875b43-283f-41fb-a402-d61c85d4fe60 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:04.715955 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9e0ce652-5fee-40c2-a732-893052be8b3f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:04.716411 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9e0ce652-5fee-40c2-a732-893052be8b3f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:04.717174 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9e0ce652-5fee-40c2-a732-893052be8b3f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:04.717605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9e0ce652-5fee-40c2-a732-893052be8b3f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:04.939357 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-d9875b43-283f-41fb-a402-d61c85d4fe60 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:04.947086 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-d9875b43-283f-41fb-a402-d61c85d4fe60 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831" status: 200 len: 1318 microversion: 2.1 time: 0.247171 Jun 27 18:48:04.947661 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 174/360] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:04 2022] GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:04.952209 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-9e0ce652-5fee-40c2-a732-893052be8b3f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:04.960329 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-9e0ce652-5fee-40c2-a732-893052be8b3f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1501 microversion: 2.1 time: 0.255874 Jun 27 18:48:04.961046 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 187/361] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:04 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1501 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:48:04.982921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-91209a15-3d20-4f21-af12-042ef9cdac85 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:04.983665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-91209a15-3d20-4f21-af12-042ef9cdac85 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:04.989789 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-91209a15-3d20-4f21-af12-042ef9cdac85 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:04.996027 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-91209a15-3d20-4f21-af12-042ef9cdac85 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:04.996027 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-91209a15-3d20-4f21-af12-042ef9cdac85 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:04.996027 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-91209a15-3d20-4f21-af12-042ef9cdac85 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:05.092314 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-82309cad-cd58-4791-8681-024ea1052dfd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:05.092314 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-82309cad-cd58-4791-8681-024ea1052dfd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:05.092314 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-82309cad-cd58-4791-8681-024ea1052dfd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:05.092314 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-82309cad-cd58-4791-8681-024ea1052dfd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:05.092721 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-82309cad-cd58-4791-8681-024ea1052dfd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:05.092721 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-82309cad-cd58-4791-8681-024ea1052dfd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:05.169956 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-91209a15-3d20-4f21-af12-042ef9cdac85 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:05.178670 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-91209a15-3d20-4f21-af12-042ef9cdac85 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1516 microversion: 2.1 time: 0.200495 Jun 27 18:48:05.179479 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 175/362] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:04 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1516 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:05.315442 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-82309cad-cd58-4791-8681-024ea1052dfd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:05.338531 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-82309cad-cd58-4791-8681-024ea1052dfd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:05.343649 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-82309cad-cd58-4791-8681-024ea1052dfd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:05.358985 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-82309cad-cd58-4791-8681-024ea1052dfd tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1808 microversion: 2.20 time: 0.269194 Jun 27 18:48:05.360249 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 188/363] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:48:05 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1808 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:48:05.405641 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-2ef36d1f-bfcb-42bc-b33a-4f86fedac345 req-fa65bae4-07f6-4938-8a8a-c8d83103b3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab81efbc-7e62-4405-a45a-5d8448895831", "name": "network-vif-plugged", "status": "completed", "tag": "9e4f60d5-1a7d-41b7-903c-ffe073243353"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:48:05.415361 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-2ef36d1f-bfcb-42bc-b33a-4f86fedac345 req-fa65bae4-07f6-4938-8a8a-c8d83103b3d3 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:05.418700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-2ef36d1f-bfcb-42bc-b33a-4f86fedac345 req-fa65bae4-07f6-4938-8a8a-c8d83103b3d3 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:05.427061 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-2ef36d1f-bfcb-42bc-b33a-4f86fedac345 req-fa65bae4-07f6-4938-8a8a-c8d83103b3d3 service nova] Creating event network-vif-plugged:9e4f60d5-1a7d-41b7-903c-ffe073243353 for instance ab81efbc-7e62-4405-a45a-5d8448895831 on hv-cinder-84460 Jun 27 18:48:05.432023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-2ef36d1f-bfcb-42bc-b33a-4f86fedac345 req-fa65bae4-07f6-4938-8a8a-c8d83103b3d3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030036 Jun 27 18:48:05.432778 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 176/364] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:48:05.964502 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-e12fce99-5e2a-4822-b45e-2e0512abb3f1 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:05.965139 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-e12fce99-5e2a-4822-b45e-2e0512abb3f1 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:05.975238 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e12fce99-5e2a-4822-b45e-2e0512abb3f1 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:05.975688 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e12fce99-5e2a-4822-b45e-2e0512abb3f1 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:05.976462 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e12fce99-5e2a-4822-b45e-2e0512abb3f1 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:05.977371 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e12fce99-5e2a-4822-b45e-2e0512abb3f1 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:06.121252 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-e12fce99-5e2a-4822-b45e-2e0512abb3f1 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:06.128906 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-e12fce99-5e2a-4822-b45e-2e0512abb3f1 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831" status: 200 len: 1318 microversion: 2.1 time: 0.168965 Jun 27 18:48:06.129518 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 189/365] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:05 2022] GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:06.367004 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-c18e389f-76b3-4589-91d8-39df80d63374 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:06.368421 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-c18e389f-76b3-4589-91d8-39df80d63374 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:06.375900 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c18e389f-76b3-4589-91d8-39df80d63374 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:06.376354 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c18e389f-76b3-4589-91d8-39df80d63374 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:06.377193 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c18e389f-76b3-4589-91d8-39df80d63374 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:06.377633 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c18e389f-76b3-4589-91d8-39df80d63374 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:06.527931 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-c18e389f-76b3-4589-91d8-39df80d63374 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:06.540119 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-c18e389f-76b3-4589-91d8-39df80d63374 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:06.542426 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-c18e389f-76b3-4589-91d8-39df80d63374 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:06.543811 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-c18e389f-76b3-4589-91d8-39df80d63374 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1795 microversion: 2.20 time: 0.181185 Jun 27 18:48:06.557021 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 177/366] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:48:06 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1795 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:48:07.146506 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-8e6c2d5a-c6fd-41fc-9b1a-905997cd8df7 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:07.147116 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-8e6c2d5a-c6fd-41fc-9b1a-905997cd8df7 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:07.153731 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8e6c2d5a-c6fd-41fc-9b1a-905997cd8df7 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:07.154220 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8e6c2d5a-c6fd-41fc-9b1a-905997cd8df7 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:07.155017 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8e6c2d5a-c6fd-41fc-9b1a-905997cd8df7 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:07.155451 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8e6c2d5a-c6fd-41fc-9b1a-905997cd8df7 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:07.296197 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-8e6c2d5a-c6fd-41fc-9b1a-905997cd8df7 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:07.303930 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-8e6c2d5a-c6fd-41fc-9b1a-905997cd8df7 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831" status: 200 len: 1318 microversion: 2.1 time: 0.161319 Jun 27 18:48:07.304513 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 190/367] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:07 2022] GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:07.333844 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-d786f4e2-9acf-4740-a4bb-71eece57bbba tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:48:07.334865 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-d786f4e2-9acf-4740-a4bb-71eece57bbba tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:07.342906 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d786f4e2-9acf-4740-a4bb-71eece57bbba tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:07.343387 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d786f4e2-9acf-4740-a4bb-71eece57bbba tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:07.344163 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d786f4e2-9acf-4740-a4bb-71eece57bbba tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:07.344603 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d786f4e2-9acf-4740-a4bb-71eece57bbba tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:07.371383 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.objects.instance [None req-d786f4e2-9acf-4740-a4bb-71eece57bbba tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lazy-loading 'flavor' on Instance uuid 657439fb-0239-40b2-9be0-56c5b7dc558c {{(pid=124717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:48:07.639267 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-d786f4e2-9acf-4740-a4bb-71eece57bbba tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "POST /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c/action" status: 200 len: 32 microversion: 2.1 time: 0.309332 Jun 27 18:48:07.639909 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 178/368] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Jun 27 18:48:07 2022] POST /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c/action => generated 32 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 18:48:07.648949 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-78a7bcb4-e2ea-4b71-9d68-7858435f4013 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:07.649685 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-78a7bcb4-e2ea-4b71-9d68-7858435f4013 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:07.655825 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-78a7bcb4-e2ea-4b71-9d68-7858435f4013 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:07.656273 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-78a7bcb4-e2ea-4b71-9d68-7858435f4013 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:07.657029 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-78a7bcb4-e2ea-4b71-9d68-7858435f4013 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:07.657467 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-78a7bcb4-e2ea-4b71-9d68-7858435f4013 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:07.792403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-78a7bcb4-e2ea-4b71-9d68-7858435f4013 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:07.805151 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-78a7bcb4-e2ea-4b71-9d68-7858435f4013 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.155008 Jun 27 18:48:07.805151 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 191/369] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:07 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:08.322959 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-fca98919-1071-47f8-b138-11a6ba02215b tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:08.323702 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-fca98919-1071-47f8-b138-11a6ba02215b tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:08.329890 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-fca98919-1071-47f8-b138-11a6ba02215b tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:08.330333 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-fca98919-1071-47f8-b138-11a6ba02215b tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:08.331110 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-fca98919-1071-47f8-b138-11a6ba02215b tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:08.331542 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-fca98919-1071-47f8-b138-11a6ba02215b tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:08.475668 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-fca98919-1071-47f8-b138-11a6ba02215b tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:08.479413 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f1e360fe-c49a-49e2-9e1d-299d672f04c0 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-932566406", "imageRef": "c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3", "flavorRef": "452", "networks": [{"uuid": "54b444a0-be0c-4187-a1dd-ddf34a53d1fb"}]}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:48:08.484341 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-fca98919-1071-47f8-b138-11a6ba02215b tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831" status: 200 len: 1507 microversion: 2.1 time: 0.167494 Jun 27 18:48:08.484917 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 179/370] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:08 2022] GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:08.540022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.network.neutron [None req-f1e360fe-c49a-49e2-9e1d-299d672f04c0 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] validate_networks() for [('54b444a0-be0c-4187-a1dd-ddf34a53d1fb', None, None, None, None, None)] {{(pid=124716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 18:48:08.817215 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-8a41a272-9d18-46ef-a69d-65e323d88ffa tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:08.817906 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-8a41a272-9d18-46ef-a69d-65e323d88ffa tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:08.824309 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8a41a272-9d18-46ef-a69d-65e323d88ffa tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:08.824762 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8a41a272-9d18-46ef-a69d-65e323d88ffa tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:08.825541 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8a41a272-9d18-46ef-a69d-65e323d88ffa tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:08.825981 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8a41a272-9d18-46ef-a69d-65e323d88ffa tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:08.977386 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-f1e360fe-c49a-49e2-9e1d-299d672f04c0 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Flavor limits 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 18:48:08.978062 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-f1e360fe-c49a-49e2-9e1d-299d672f04c0 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Image limits 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 18:48:08.978910 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-f1e360fe-c49a-49e2-9e1d-299d672f04c0 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Flavor pref 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 18:48:08.979652 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-f1e360fe-c49a-49e2-9e1d-299d672f04c0 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Image pref 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 18:48:08.980127 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-f1e360fe-c49a-49e2-9e1d-299d672f04c0 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 18:48:08.994567 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f1e360fe-c49a-49e2-9e1d-299d672f04c0 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:08.995254 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f1e360fe-c49a-49e2-9e1d-299d672f04c0 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:08.996780 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f1e360fe-c49a-49e2-9e1d-299d672f04c0 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:08.997300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f1e360fe-c49a-49e2-9e1d-299d672f04c0 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:09.016614 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-f1e360fe-c49a-49e2-9e1d-299d672f04c0 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Getting quotas for project bc7a3d93a3a84224b7b23d93924f276f. Resources: {'ram', 'cores', 'instances'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:48:09.020435 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-8a41a272-9d18-46ef-a69d-65e323d88ffa tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:09.020666 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-f1e360fe-c49a-49e2-9e1d-299d672f04c0 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Getting quotas for user d3c1ad9da81f48c390ad82e10e44712d and project bc7a3d93a3a84224b7b23d93924f276f. Resources: {'ram', 'cores', 'instances'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:48:09.029092 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-8a41a272-9d18-46ef-a69d-65e323d88ffa tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.215786 Jun 27 18:48:09.029704 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 180/371] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:08 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:48:09.033249 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f1e360fe-c49a-49e2-9e1d-299d672f04c0 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Going to run 1 instances... {{(pid=124716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 18:48:09.035446 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f1e360fe-c49a-49e2-9e1d-299d672f04c0 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: b5dec71a-e9a3-43b2-9081-263a3275847c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 18:48:09.194753 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f1e360fe-c49a-49e2-9e1d-299d672f04c0 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719667 Jun 27 18:48:09.196202 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 192/372] 10.222.0.15 () {60 vars in 1146 bytes} [Mon Jun 27 18:48:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 18:48:09.206482 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-b9c9a5c3-527d-4da4-8547-5ea19e07e982 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:09.207151 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-b9c9a5c3-527d-4da4-8547-5ea19e07e982 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: b5dec71a-e9a3-43b2-9081-263a3275847c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:09.266634 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-b9c9a5c3-527d-4da4-8547-5ea19e07e982 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:09.283798 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-b9c9a5c3-527d-4da4-8547-5ea19e07e982 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c" status: 200 len: 1213 microversion: 2.1 time: 0.081219 Jun 27 18:48:09.284368 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 181/373] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:09 2022] GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:10.046162 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-c5d6583b-097f-4df8-8251-cd901198672c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:10.047010 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-c5d6583b-097f-4df8-8251-cd901198672c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:10.053245 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c5d6583b-097f-4df8-8251-cd901198672c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:10.053770 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c5d6583b-097f-4df8-8251-cd901198672c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:10.055066 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c5d6583b-097f-4df8-8251-cd901198672c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:10.055798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c5d6583b-097f-4df8-8251-cd901198672c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:10.185910 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c5d6583b-097f-4df8-8251-cd901198672c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:10.193374 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-c5d6583b-097f-4df8-8251-cd901198672c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.151321 Jun 27 18:48:10.193964 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 193/374] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:10 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:10.301248 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-c20f51dd-11a9-4245-bfdd-8675296c5b3b tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:10.301782 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-c20f51dd-11a9-4245-bfdd-8675296c5b3b tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: b5dec71a-e9a3-43b2-9081-263a3275847c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:10.308462 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c20f51dd-11a9-4245-bfdd-8675296c5b3b tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:10.308918 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c20f51dd-11a9-4245-bfdd-8675296c5b3b tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:10.309676 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c20f51dd-11a9-4245-bfdd-8675296c5b3b tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:10.310114 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c20f51dd-11a9-4245-bfdd-8675296c5b3b tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:10.377328 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-c20f51dd-11a9-4245-bfdd-8675296c5b3b tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:10.385735 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-c20f51dd-11a9-4245-bfdd-8675296c5b3b tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c" status: 200 len: 1217 microversion: 2.1 time: 0.088439 Jun 27 18:48:10.386371 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 182/375] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:10 2022] GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:11.210673 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-23e129d1-8c35-4d90-bc6d-fded16ce8f32 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:11.211291 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-23e129d1-8c35-4d90-bc6d-fded16ce8f32 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:11.217246 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-23e129d1-8c35-4d90-bc6d-fded16ce8f32 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:11.217691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-23e129d1-8c35-4d90-bc6d-fded16ce8f32 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:11.218469 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-23e129d1-8c35-4d90-bc6d-fded16ce8f32 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:11.218905 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-23e129d1-8c35-4d90-bc6d-fded16ce8f32 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:11.348621 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-23e129d1-8c35-4d90-bc6d-fded16ce8f32 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:11.357853 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-23e129d1-8c35-4d90-bc6d-fded16ce8f32 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.151109 Jun 27 18:48:11.358426 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 194/376] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:11 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:11.408086 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-29da8de2-d8d7-46a6-8d8a-e16ca1ee296a tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:11.409237 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-29da8de2-d8d7-46a6-8d8a-e16ca1ee296a tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: b5dec71a-e9a3-43b2-9081-263a3275847c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:11.421579 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-29da8de2-d8d7-46a6-8d8a-e16ca1ee296a tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:11.423979 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-29da8de2-d8d7-46a6-8d8a-e16ca1ee296a tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:11.423979 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-29da8de2-d8d7-46a6-8d8a-e16ca1ee296a tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:11.424571 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-29da8de2-d8d7-46a6-8d8a-e16ca1ee296a tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:11.491262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-29da8de2-d8d7-46a6-8d8a-e16ca1ee296a tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:11.499047 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-29da8de2-d8d7-46a6-8d8a-e16ca1ee296a tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c" status: 200 len: 1217 microversion: 2.1 time: 0.098262 Jun 27 18:48:11.499613 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 183/377] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:11 2022] GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:12.375271 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a7df2782-fb7f-4185-a0de-471cbc539dd6 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:12.375914 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a7df2782-fb7f-4185-a0de-471cbc539dd6 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:12.381918 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a7df2782-fb7f-4185-a0de-471cbc539dd6 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:12.382366 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a7df2782-fb7f-4185-a0de-471cbc539dd6 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:12.383167 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a7df2782-fb7f-4185-a0de-471cbc539dd6 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:12.383601 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a7df2782-fb7f-4185-a0de-471cbc539dd6 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:12.516121 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-2ac1a9ff-1242-4127-8423-d61bf3942cea tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:12.516747 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-2ac1a9ff-1242-4127-8423-d61bf3942cea tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: b5dec71a-e9a3-43b2-9081-263a3275847c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:12.524005 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2ac1a9ff-1242-4127-8423-d61bf3942cea tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:12.524509 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2ac1a9ff-1242-4127-8423-d61bf3942cea tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:12.525552 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a7df2782-fb7f-4185-a0de-471cbc539dd6 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:12.525895 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2ac1a9ff-1242-4127-8423-d61bf3942cea tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:12.526335 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2ac1a9ff-1242-4127-8423-d61bf3942cea tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:12.535127 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a7df2782-fb7f-4185-a0de-471cbc539dd6 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.163472 Jun 27 18:48:12.535990 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 195/378] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:12 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:12.596386 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-2ac1a9ff-1242-4127-8423-d61bf3942cea tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:12.604950 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-2ac1a9ff-1242-4127-8423-d61bf3942cea tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c" status: 200 len: 1265 microversion: 2.1 time: 0.093682 Jun 27 18:48:12.605524 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 184/379] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:12 2022] GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:13.554509 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-9e20cac5-11d5-4e2b-99b2-062b7a2be977 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:13.555200 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-9e20cac5-11d5-4e2b-99b2-062b7a2be977 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:13.562112 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9e20cac5-11d5-4e2b-99b2-062b7a2be977 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:13.562611 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9e20cac5-11d5-4e2b-99b2-062b7a2be977 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:13.563380 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9e20cac5-11d5-4e2b-99b2-062b7a2be977 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:13.563824 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9e20cac5-11d5-4e2b-99b2-062b7a2be977 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:13.624373 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-c64e5489-30e9-408b-bf82-7053ff93bdca tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:13.625014 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-c64e5489-30e9-408b-bf82-7053ff93bdca tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: b5dec71a-e9a3-43b2-9081-263a3275847c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:13.635134 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c64e5489-30e9-408b-bf82-7053ff93bdca tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:13.635620 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c64e5489-30e9-408b-bf82-7053ff93bdca tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:13.636563 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c64e5489-30e9-408b-bf82-7053ff93bdca tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:13.637049 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c64e5489-30e9-408b-bf82-7053ff93bdca tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:13.722283 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-c64e5489-30e9-408b-bf82-7053ff93bdca tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:13.730831 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-c64e5489-30e9-408b-bf82-7053ff93bdca tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c" status: 200 len: 1271 microversion: 2.1 time: 0.110587 Jun 27 18:48:13.731422 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 185/380] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:13 2022] GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c => generated 1271 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:48:13.833747 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-9e20cac5-11d5-4e2b-99b2-062b7a2be977 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:13.850638 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-9e20cac5-11d5-4e2b-99b2-062b7a2be977 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.299900 Jun 27 18:48:13.851241 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 196/381] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:13 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:14.749376 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-b2af52d0-dbfd-4b79-8766-05ca90bd0e2b tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:14.750029 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-b2af52d0-dbfd-4b79-8766-05ca90bd0e2b tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: b5dec71a-e9a3-43b2-9081-263a3275847c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:14.759097 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b2af52d0-dbfd-4b79-8766-05ca90bd0e2b tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:14.759460 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b2af52d0-dbfd-4b79-8766-05ca90bd0e2b tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:14.760232 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b2af52d0-dbfd-4b79-8766-05ca90bd0e2b tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:14.760666 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b2af52d0-dbfd-4b79-8766-05ca90bd0e2b tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:14.867620 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-c0233bc7-0928-474c-8596-14f7a1866b30 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:14.869126 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-c0233bc7-0928-474c-8596-14f7a1866b30 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:14.875202 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c0233bc7-0928-474c-8596-14f7a1866b30 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:14.875653 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c0233bc7-0928-474c-8596-14f7a1866b30 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:14.876504 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c0233bc7-0928-474c-8596-14f7a1866b30 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:14.877074 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c0233bc7-0928-474c-8596-14f7a1866b30 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:15.015062 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-b2af52d0-dbfd-4b79-8766-05ca90bd0e2b tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:15.025938 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-b2af52d0-dbfd-4b79-8766-05ca90bd0e2b tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c" status: 200 len: 1313 microversion: 2.1 time: 0.282919 Jun 27 18:48:15.026815 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 186/382] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:14 2022] GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:15.058531 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c0233bc7-0928-474c-8596-14f7a1866b30 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:15.066730 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-c0233bc7-0928-474c-8596-14f7a1866b30 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.203111 Jun 27 18:48:15.067332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 197/383] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:14 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:48:15.250300 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-c1e47f58-7746-40d2-ac94-564fb259651e req-e3140ad2-d562-4f00-9fa4-a177de3bdfd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5dec71a-e9a3-43b2-9081-263a3275847c", "tag": "2764ee2d-8b02-45bd-86ec-6a1593906cb2"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:48:15.258877 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-c1e47f58-7746-40d2-ac94-564fb259651e req-e3140ad2-d562-4f00-9fa4-a177de3bdfd8 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:15.259886 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-c1e47f58-7746-40d2-ac94-564fb259651e req-e3140ad2-d562-4f00-9fa4-a177de3bdfd8 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:15.276368 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-c1e47f58-7746-40d2-ac94-564fb259651e req-e3140ad2-d562-4f00-9fa4-a177de3bdfd8 service nova] Creating event network-changed:2764ee2d-8b02-45bd-86ec-6a1593906cb2 for instance b5dec71a-e9a3-43b2-9081-263a3275847c on hv-cinder-84460 Jun 27 18:48:15.282488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-c1e47f58-7746-40d2-ac94-564fb259651e req-e3140ad2-d562-4f00-9fa4-a177de3bdfd8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036316 Jun 27 18:48:15.283992 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 187/384] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:48:16.044749 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-b8cc73ed-99af-4b75-bcab-54c86bebf1de tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:16.045394 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-b8cc73ed-99af-4b75-bcab-54c86bebf1de tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: b5dec71a-e9a3-43b2-9081-263a3275847c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:16.051559 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b8cc73ed-99af-4b75-bcab-54c86bebf1de tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:16.052081 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b8cc73ed-99af-4b75-bcab-54c86bebf1de tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:16.053019 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b8cc73ed-99af-4b75-bcab-54c86bebf1de tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:16.057172 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b8cc73ed-99af-4b75-bcab-54c86bebf1de tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:16.084939 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-2ad42988-c705-4da4-b6c1-03bdcbbb9af0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:16.087307 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-2ad42988-c705-4da4-b6c1-03bdcbbb9af0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:16.094245 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2ad42988-c705-4da4-b6c1-03bdcbbb9af0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:16.094988 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2ad42988-c705-4da4-b6c1-03bdcbbb9af0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:16.095758 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2ad42988-c705-4da4-b6c1-03bdcbbb9af0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:16.096195 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2ad42988-c705-4da4-b6c1-03bdcbbb9af0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:16.341202 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-b8cc73ed-99af-4b75-bcab-54c86bebf1de tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:16.350322 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-b8cc73ed-99af-4b75-bcab-54c86bebf1de tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c" status: 200 len: 1313 microversion: 2.1 time: 0.310799 Jun 27 18:48:16.350952 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 198/385] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:16 2022] GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:16.363593 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-2ad42988-c705-4da4-b6c1-03bdcbbb9af0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:16.372195 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-2ad42988-c705-4da4-b6c1-03bdcbbb9af0 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.291377 Jun 27 18:48:16.372764 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 188/386] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:16 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:48:17.367730 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-3b9292bf-ae49-42a4-8416-62b033383097 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:17.369310 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-3b9292bf-ae49-42a4-8416-62b033383097 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: b5dec71a-e9a3-43b2-9081-263a3275847c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:17.375259 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3b9292bf-ae49-42a4-8416-62b033383097 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:17.375704 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3b9292bf-ae49-42a4-8416-62b033383097 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:17.376457 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3b9292bf-ae49-42a4-8416-62b033383097 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:17.376885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3b9292bf-ae49-42a4-8416-62b033383097 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:17.389816 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a26a2871-52c8-43bf-b812-829fe9ea567b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:17.390428 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-a26a2871-52c8-43bf-b812-829fe9ea567b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:17.397395 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a26a2871-52c8-43bf-b812-829fe9ea567b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:17.397844 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a26a2871-52c8-43bf-b812-829fe9ea567b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:17.398632 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a26a2871-52c8-43bf-b812-829fe9ea567b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:17.399788 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a26a2871-52c8-43bf-b812-829fe9ea567b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:17.588076 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3b9292bf-ae49-42a4-8416-62b033383097 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:17.595776 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a26a2871-52c8-43bf-b812-829fe9ea567b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:17.595776 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:48:17.596154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-3b9292bf-ae49-42a4-8416-62b033383097 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c" status: 200 len: 1313 microversion: 2.1 time: 0.231884 Jun 27 18:48:17.596255 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 199/387] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:17 2022] GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:17.599138 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-a26a2871-52c8-43bf-b812-829fe9ea567b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.213447 Jun 27 18:48:17.599698 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 189/388] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:17 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:18.613467 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-ac302800-22c7-41fa-8901-844080a4a88b tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:18.614167 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-ac302800-22c7-41fa-8901-844080a4a88b tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: b5dec71a-e9a3-43b2-9081-263a3275847c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:18.615929 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a1716bed-5efe-48a0-9f42-d490eaa03568 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:18.616551 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-a1716bed-5efe-48a0-9f42-d490eaa03568 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:18.620448 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ac302800-22c7-41fa-8901-844080a4a88b tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:18.620940 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ac302800-22c7-41fa-8901-844080a4a88b tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:18.621759 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ac302800-22c7-41fa-8901-844080a4a88b tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:18.622201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ac302800-22c7-41fa-8901-844080a4a88b tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:18.629047 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a1716bed-5efe-48a0-9f42-d490eaa03568 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:18.629047 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a1716bed-5efe-48a0-9f42-d490eaa03568 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:18.629047 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a1716bed-5efe-48a0-9f42-d490eaa03568 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:18.629047 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a1716bed-5efe-48a0-9f42-d490eaa03568 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:18.840532 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a1716bed-5efe-48a0-9f42-d490eaa03568 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:18.844066 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-ac302800-22c7-41fa-8901-844080a4a88b tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:18.848486 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-a1716bed-5efe-48a0-9f42-d490eaa03568 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.236398 Jun 27 18:48:18.849245 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 190/389] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:18 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:18.852498 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-ac302800-22c7-41fa-8901-844080a4a88b tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c" status: 200 len: 1313 microversion: 2.1 time: 0.242843 Jun 27 18:48:18.853297 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 200/390] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:18 2022] GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:19.869585 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-20a69bea-3e08-4e33-b8cd-1fe08c52fcce tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:19.870839 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-fe07199c-4dac-4b47-a458-6c9d4b224238 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:19.871270 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-20a69bea-3e08-4e33-b8cd-1fe08c52fcce tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:19.871364 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-fe07199c-4dac-4b47-a458-6c9d4b224238 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: b5dec71a-e9a3-43b2-9081-263a3275847c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:19.873952 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell0:SELECT=2 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:48:19.875904 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=2 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:48:19.882003 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-20a69bea-3e08-4e33-b8cd-1fe08c52fcce tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:19.882351 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=6 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:48:19.884039 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-20a69bea-3e08-4e33-b8cd-1fe08c52fcce tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:19.885383 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-20a69bea-3e08-4e33-b8cd-1fe08c52fcce tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:19.885546 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fe07199c-4dac-4b47-a458-6c9d4b224238 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:19.885850 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-20a69bea-3e08-4e33-b8cd-1fe08c52fcce tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:19.886349 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fe07199c-4dac-4b47-a458-6c9d4b224238 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:19.887160 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fe07199c-4dac-4b47-a458-6c9d4b224238 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:19.887609 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fe07199c-4dac-4b47-a458-6c9d4b224238 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:20.111506 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-20a69bea-3e08-4e33-b8cd-1fe08c52fcce tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:20.122133 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-fe07199c-4dac-4b47-a458-6c9d4b224238 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:20.123567 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-20a69bea-3e08-4e33-b8cd-1fe08c52fcce tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.260712 Jun 27 18:48:20.124366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 191/391] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:19 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:20.131168 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-fe07199c-4dac-4b47-a458-6c9d4b224238 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c" status: 200 len: 1313 microversion: 2.1 time: 0.265854 Jun 27 18:48:20.131731 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 201/392] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:19 2022] GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:48:21.140600 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-96625ee4-c58d-4cbe-af93-f9f5dee1b984 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:21.141407 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-96625ee4-c58d-4cbe-af93-f9f5dee1b984 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:21.147717 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-78ec3709-df58-4253-ba04-cb1e188c379c tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:21.148411 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-96625ee4-c58d-4cbe-af93-f9f5dee1b984 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:21.148551 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-78ec3709-df58-4253-ba04-cb1e188c379c tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: b5dec71a-e9a3-43b2-9081-263a3275847c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:21.149025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-96625ee4-c58d-4cbe-af93-f9f5dee1b984 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:21.149876 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-96625ee4-c58d-4cbe-af93-f9f5dee1b984 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:21.150397 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-96625ee4-c58d-4cbe-af93-f9f5dee1b984 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:21.155237 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-78ec3709-df58-4253-ba04-cb1e188c379c tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:21.155686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-78ec3709-df58-4253-ba04-cb1e188c379c tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:21.156454 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-78ec3709-df58-4253-ba04-cb1e188c379c tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:21.156918 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-78ec3709-df58-4253-ba04-cb1e188c379c tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:21.373800 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-78ec3709-df58-4253-ba04-cb1e188c379c tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:21.378160 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-78ec3709-df58-4253-ba04-cb1e188c379c tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c" status: 200 len: 1313 microversion: 2.1 time: 0.234388 Jun 27 18:48:21.378525 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-96625ee4-c58d-4cbe-af93-f9f5dee1b984 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:21.379723 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 202/393] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:21 2022] GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:48:21.387417 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-96625ee4-c58d-4cbe-af93-f9f5dee1b984 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.250297 Jun 27 18:48:21.388005 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 192/394] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:21 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:21.615079 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-4e52b1cc-1743-419d-8cd9-dcf59e155c53 req-1680ed40-9cf2-454c-822d-962572ba213e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5dec71a-e9a3-43b2-9081-263a3275847c", "name": "network-vif-plugged", "status": "completed", "tag": "2764ee2d-8b02-45bd-86ec-6a1593906cb2"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:48:21.631599 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-4e52b1cc-1743-419d-8cd9-dcf59e155c53 req-1680ed40-9cf2-454c-822d-962572ba213e service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:21.631599 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-4e52b1cc-1743-419d-8cd9-dcf59e155c53 req-1680ed40-9cf2-454c-822d-962572ba213e service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:21.642691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-4e52b1cc-1743-419d-8cd9-dcf59e155c53 req-1680ed40-9cf2-454c-822d-962572ba213e service nova] Creating event network-vif-plugged:2764ee2d-8b02-45bd-86ec-6a1593906cb2 for instance b5dec71a-e9a3-43b2-9081-263a3275847c on hv-cinder-84460 Jun 27 18:48:21.647661 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-4e52b1cc-1743-419d-8cd9-dcf59e155c53 req-1680ed40-9cf2-454c-822d-962572ba213e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036838 Jun 27 18:48:21.648249 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 203/395] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:48:22.397233 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-8eb3237c-7b9d-4f29-93fc-ebafeb131731 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:22.397861 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-8eb3237c-7b9d-4f29-93fc-ebafeb131731 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: b5dec71a-e9a3-43b2-9081-263a3275847c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:22.405027 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-9c7db7f3-24f4-49bf-86b6-e74ac345d915 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:22.405531 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8eb3237c-7b9d-4f29-93fc-ebafeb131731 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:22.405719 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8eb3237c-7b9d-4f29-93fc-ebafeb131731 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:22.405840 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-9c7db7f3-24f4-49bf-86b6-e74ac345d915 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:22.406531 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8eb3237c-7b9d-4f29-93fc-ebafeb131731 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:22.406973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8eb3237c-7b9d-4f29-93fc-ebafeb131731 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:22.412026 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9c7db7f3-24f4-49bf-86b6-e74ac345d915 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:22.412709 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9c7db7f3-24f4-49bf-86b6-e74ac345d915 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:22.413522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9c7db7f3-24f4-49bf-86b6-e74ac345d915 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:22.414038 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9c7db7f3-24f4-49bf-86b6-e74ac345d915 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:22.430973 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=100 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:48:22.654254 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-8eb3237c-7b9d-4f29-93fc-ebafeb131731 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:22.662572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-9c7db7f3-24f4-49bf-86b6-e74ac345d915 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:22.665524 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-8eb3237c-7b9d-4f29-93fc-ebafeb131731 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c" status: 200 len: 1313 microversion: 2.1 time: 0.271291 Jun 27 18:48:22.666130 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 193/396] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:22 2022] GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:22.679499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-9c7db7f3-24f4-49bf-86b6-e74ac345d915 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.278592 Jun 27 18:48:22.680157 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 204/397] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:22 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:48:23.696439 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-25485d74-f72c-45d0-937e-f25c3d65eaef tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:23.697732 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-8ad13992-15f1-4861-9bfe-eed4dd06f935 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:23.698175 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-25485d74-f72c-45d0-937e-f25c3d65eaef tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:23.702708 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-8ad13992-15f1-4861-9bfe-eed4dd06f935 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: b5dec71a-e9a3-43b2-9081-263a3275847c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:23.713262 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-25485d74-f72c-45d0-937e-f25c3d65eaef tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:23.713726 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-25485d74-f72c-45d0-937e-f25c3d65eaef tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:23.719104 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-25485d74-f72c-45d0-937e-f25c3d65eaef tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:23.719603 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-25485d74-f72c-45d0-937e-f25c3d65eaef tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:23.726241 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8ad13992-15f1-4861-9bfe-eed4dd06f935 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:23.727814 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8ad13992-15f1-4861-9bfe-eed4dd06f935 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:23.729430 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8ad13992-15f1-4861-9bfe-eed4dd06f935 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:23.730610 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8ad13992-15f1-4861-9bfe-eed4dd06f935 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:24.007935 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-25485d74-f72c-45d0-937e-f25c3d65eaef tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:24.016893 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-8ad13992-15f1-4861-9bfe-eed4dd06f935 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:24.017887 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-25485d74-f72c-45d0-937e-f25c3d65eaef tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.326111 Jun 27 18:48:24.018669 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 205/398] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:23 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:48:24.030307 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-8ad13992-15f1-4861-9bfe-eed4dd06f935 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c" status: 200 len: 1313 microversion: 2.1 time: 0.345304 Jun 27 18:48:24.030307 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 194/399] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:23 2022] GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:25.037275 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-9883486b-0df5-484a-a3e6-589e853323df tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:25.037836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-9883486b-0df5-484a-a3e6-589e853323df tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:25.047730 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9883486b-0df5-484a-a3e6-589e853323df tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:25.048477 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9883486b-0df5-484a-a3e6-589e853323df tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:25.049319 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-183716e6-0277-45d8-99c5-acc6f6a8c877 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:25.050229 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9883486b-0df5-484a-a3e6-589e853323df tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:25.050357 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-183716e6-0277-45d8-99c5-acc6f6a8c877 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: b5dec71a-e9a3-43b2-9081-263a3275847c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:25.050950 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9883486b-0df5-484a-a3e6-589e853323df tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:25.057442 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-183716e6-0277-45d8-99c5-acc6f6a8c877 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:25.062009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-183716e6-0277-45d8-99c5-acc6f6a8c877 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:25.062009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-183716e6-0277-45d8-99c5-acc6f6a8c877 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:25.062009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-183716e6-0277-45d8-99c5-acc6f6a8c877 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:25.275098 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-183716e6-0277-45d8-99c5-acc6f6a8c877 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:25.282951 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-183716e6-0277-45d8-99c5-acc6f6a8c877 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c" status: 200 len: 1496 microversion: 2.1 time: 0.239362 Jun 27 18:48:25.289037 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 206/400] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:25 2022] GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c => generated 1496 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:25.313517 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-9883486b-0df5-484a-a3e6-589e853323df tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:25.322557 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-9883486b-0df5-484a-a3e6-589e853323df tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.289084 Jun 27 18:48:25.323197 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 195/401] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:25 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:48:26.340137 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-264ed7c4-f22f-4fac-ab30-e9f28d823636 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:26.340787 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-264ed7c4-f22f-4fac-ab30-e9f28d823636 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:26.347257 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-264ed7c4-f22f-4fac-ab30-e9f28d823636 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:26.348973 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-264ed7c4-f22f-4fac-ab30-e9f28d823636 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:26.348973 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-264ed7c4-f22f-4fac-ab30-e9f28d823636 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:26.348973 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-264ed7c4-f22f-4fac-ab30-e9f28d823636 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:26.436348 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-38b1cfba-8371-4328-a702-a1030fad54cb tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:26.437755 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-38b1cfba-8371-4328-a702-a1030fad54cb tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: b5dec71a-e9a3-43b2-9081-263a3275847c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:26.445037 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-38b1cfba-8371-4328-a702-a1030fad54cb tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:26.445720 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-38b1cfba-8371-4328-a702-a1030fad54cb tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:26.447026 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-38b1cfba-8371-4328-a702-a1030fad54cb tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:26.447339 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-38b1cfba-8371-4328-a702-a1030fad54cb tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:26.480653 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-38b1cfba-8371-4328-a702-a1030fad54cb tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: b5dec71a-e9a3-43b2-9081-263a3275847c] Going to try to terminate instance {{(pid=124717) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 18:48:26.505162 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-264ed7c4-f22f-4fac-ab30-e9f28d823636 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:26.514234 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-264ed7c4-f22f-4fac-ab30-e9f28d823636 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.178699 Jun 27 18:48:26.514879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 207/402] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:26 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:26.729444 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-38b1cfba-8371-4328-a702-a1030fad54cb tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c" status: 204 len: 0 microversion: 2.1 time: 0.298547 Jun 27 18:48:26.730033 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 196/403] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:48:26 2022] DELETE /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 18:48:26.738440 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-6f140eae-8674-42c8-ac64-22039e6896a6 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:26.739346 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-6f140eae-8674-42c8-ac64-22039e6896a6 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: b5dec71a-e9a3-43b2-9081-263a3275847c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:26.745647 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6f140eae-8674-42c8-ac64-22039e6896a6 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:26.746101 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6f140eae-8674-42c8-ac64-22039e6896a6 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:26.746914 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6f140eae-8674-42c8-ac64-22039e6896a6 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:26.747342 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6f140eae-8674-42c8-ac64-22039e6896a6 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:26.920147 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-6f140eae-8674-42c8-ac64-22039e6896a6 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:26.927809 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-6f140eae-8674-42c8-ac64-22039e6896a6 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c" status: 200 len: 1502 microversion: 2.1 time: 0.193318 Jun 27 18:48:26.928382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 208/404] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:26 2022] GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c => generated 1502 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:27.531667 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-152876c3-c321-4aa7-8874-e406286005c9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:27.532530 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-152876c3-c321-4aa7-8874-e406286005c9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:27.543351 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-152876c3-c321-4aa7-8874-e406286005c9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:27.543351 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-152876c3-c321-4aa7-8874-e406286005c9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:27.543351 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-152876c3-c321-4aa7-8874-e406286005c9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:27.543351 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-152876c3-c321-4aa7-8874-e406286005c9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:27.760353 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-152876c3-c321-4aa7-8874-e406286005c9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:27.769404 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-152876c3-c321-4aa7-8874-e406286005c9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.241871 Jun 27 18:48:27.770171 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 197/405] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:27 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:27.945681 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-ed12721e-fd94-4226-942d-c2689a424eaf tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:27.946800 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-ed12721e-fd94-4226-942d-c2689a424eaf tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: b5dec71a-e9a3-43b2-9081-263a3275847c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:27.952995 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ed12721e-fd94-4226-942d-c2689a424eaf tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:27.953444 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ed12721e-fd94-4226-942d-c2689a424eaf tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:27.954218 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ed12721e-fd94-4226-942d-c2689a424eaf tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:27.954720 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ed12721e-fd94-4226-942d-c2689a424eaf tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:28.116134 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-ed12721e-fd94-4226-942d-c2689a424eaf tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:28.124302 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-ed12721e-fd94-4226-942d-c2689a424eaf tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c" status: 200 len: 1502 microversion: 2.1 time: 0.182618 Jun 27 18:48:28.124881 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 209/406] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:27 2022] GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c => generated 1502 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:28.787184 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-99c67175-f7ea-4a9b-a6f0-4b22f40527df tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:28.787802 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-99c67175-f7ea-4a9b-a6f0-4b22f40527df tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:28.791217 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:48:28.796734 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-99c67175-f7ea-4a9b-a6f0-4b22f40527df tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:28.797190 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-99c67175-f7ea-4a9b-a6f0-4b22f40527df tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:28.797995 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-99c67175-f7ea-4a9b-a6f0-4b22f40527df tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:28.798698 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-99c67175-f7ea-4a9b-a6f0-4b22f40527df tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:29.102724 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-99c67175-f7ea-4a9b-a6f0-4b22f40527df tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:29.121136 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-99c67175-f7ea-4a9b-a6f0-4b22f40527df tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.328970 Jun 27 18:48:29.121136 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 198/407] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:28 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:29.141311 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-ccf4c96f-23a6-40a3-87e1-c6528ed5f3f4 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:29.141860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-ccf4c96f-23a6-40a3-87e1-c6528ed5f3f4 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: b5dec71a-e9a3-43b2-9081-263a3275847c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:29.147607 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:48:29.149361 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ccf4c96f-23a6-40a3-87e1-c6528ed5f3f4 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:29.149816 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ccf4c96f-23a6-40a3-87e1-c6528ed5f3f4 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:29.150624 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ccf4c96f-23a6-40a3-87e1-c6528ed5f3f4 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:29.151059 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ccf4c96f-23a6-40a3-87e1-c6528ed5f3f4 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:29.799013 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-ccf4c96f-23a6-40a3-87e1-c6528ed5f3f4 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:29.819463 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-ccf4c96f-23a6-40a3-87e1-c6528ed5f3f4 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c" status: 200 len: 1502 microversion: 2.1 time: 0.682058 Jun 27 18:48:29.830972 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 210/408] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:29 2022] GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c => generated 1502 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:30.131169 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-657fd535-58ed-4631-ae9d-f6aea3d80427 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:30.131878 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-657fd535-58ed-4631-ae9d-f6aea3d80427 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:30.147272 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-657fd535-58ed-4631-ae9d-f6aea3d80427 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:30.148225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-657fd535-58ed-4631-ae9d-f6aea3d80427 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:30.149367 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-657fd535-58ed-4631-ae9d-f6aea3d80427 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:30.150029 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-657fd535-58ed-4631-ae9d-f6aea3d80427 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:30.355086 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-657fd535-58ed-4631-ae9d-f6aea3d80427 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:30.364105 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-657fd535-58ed-4631-ae9d-f6aea3d80427 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.236788 Jun 27 18:48:30.364707 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 199/409] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:30 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:30.487154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a2619fc1-b283-4172-acfb-182c940ed3e0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "587d2dcf-fd77-4cda-9c74-d9832dba0f1e", "device": "/dev/sdb"}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:48:30.489462 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a2619fc1-b283-4172-acfb-182c940ed3e0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:30.503930 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a2619fc1-b283-4172-acfb-182c940ed3e0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:30.506885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a2619fc1-b283-4172-acfb-182c940ed3e0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:30.511958 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a2619fc1-b283-4172-acfb-182c940ed3e0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:30.512578 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a2619fc1-b283-4172-acfb-182c940ed3e0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:30.623849 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-271e0340-6095-4023-b6d5-1e72e315fea8 req-ac605030-727d-4840-bcee-7979dcb9eba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5dec71a-e9a3-43b2-9081-263a3275847c", "name": "network-vif-deleted", "tag": "2764ee2d-8b02-45bd-86ec-6a1593906cb2"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:48:30.650554 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-271e0340-6095-4023-b6d5-1e72e315fea8 req-ac605030-727d-4840-bcee-7979dcb9eba7 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:30.651557 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-271e0340-6095-4023-b6d5-1e72e315fea8 req-ac605030-727d-4840-bcee-7979dcb9eba7 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:30.693772 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-271e0340-6095-4023-b6d5-1e72e315fea8 req-ac605030-727d-4840-bcee-7979dcb9eba7 service nova] Creating event network-vif-deleted:2764ee2d-8b02-45bd-86ec-6a1593906cb2 for instance b5dec71a-e9a3-43b2-9081-263a3275847c on hv-cinder-84460 Jun 27 18:48:30.704723 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-271e0340-6095-4023-b6d5-1e72e315fea8 req-ac605030-727d-4840-bcee-7979dcb9eba7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087182 Jun 27 18:48:30.705772 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 200/410] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:48:30.838937 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-61b9d3b7-3b75-4f83-bee7-9134722eb4aa tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:30.839655 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-61b9d3b7-3b75-4f83-bee7-9134722eb4aa tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: b5dec71a-e9a3-43b2-9081-263a3275847c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:30.845983 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-61b9d3b7-3b75-4f83-bee7-9134722eb4aa tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:30.846712 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-61b9d3b7-3b75-4f83-bee7-9134722eb4aa tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:30.847677 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-61b9d3b7-3b75-4f83-bee7-9134722eb4aa tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:30.848298 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-61b9d3b7-3b75-4f83-bee7-9134722eb4aa tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:30.941993 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-61b9d3b7-3b75-4f83-bee7-9134722eb4aa tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:30.950827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-61b9d3b7-3b75-4f83-bee7-9134722eb4aa tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c" status: 200 len: 1298 microversion: 2.1 time: 0.116209 Jun 27 18:48:30.951528 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 201/411] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:30 2022] GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c => generated 1298 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:48:31.383214 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-9e359f23-5664-4f80-88fd-7c91f2575d30 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:31.384043 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-9e359f23-5664-4f80-88fd-7c91f2575d30 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:31.390454 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9e359f23-5664-4f80-88fd-7c91f2575d30 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:31.390904 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9e359f23-5664-4f80-88fd-7c91f2575d30 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:31.391717 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9e359f23-5664-4f80-88fd-7c91f2575d30 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:31.392151 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9e359f23-5664-4f80-88fd-7c91f2575d30 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:31.404532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a2619fc1-b283-4172-acfb-182c940ed3e0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "POST /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.921801 Jun 27 18:48:31.405151 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 211/412] 10.222.0.15 () {60 vars in 1322 bytes} [Mon Jun 27 18:48:30 2022] POST /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831/os-volume_attachments => generated 194 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:48:31.562208 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-9e359f23-5664-4f80-88fd-7c91f2575d30 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:31.571486 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-9e359f23-5664-4f80-88fd-7c91f2575d30 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.193312 Jun 27 18:48:31.581323 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 202/413] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:31 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:31.968206 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-6ff6580a-7227-4ec3-994f-58edfa8409c3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:31.968909 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-6ff6580a-7227-4ec3-994f-58edfa8409c3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: b5dec71a-e9a3-43b2-9081-263a3275847c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:31.975922 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6ff6580a-7227-4ec3-994f-58edfa8409c3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:31.976219 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6ff6580a-7227-4ec3-994f-58edfa8409c3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:31.977503 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6ff6580a-7227-4ec3-994f-58edfa8409c3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:31.978120 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6ff6580a-7227-4ec3-994f-58edfa8409c3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:32.011997 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6ff6580a-7227-4ec3-994f-58edfa8409c3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:32.012659 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6ff6580a-7227-4ec3-994f-58edfa8409c3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:32.013264 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.objects.instance [None req-6ff6580a-7227-4ec3-994f-58edfa8409c3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lazy-loading 'fault' on Instance uuid b5dec71a-e9a3-43b2-9081-263a3275847c {{(pid=124716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:48:32.092216 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-6ff6580a-7227-4ec3-994f-58edfa8409c3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:32.104794 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-6ff6580a-7227-4ec3-994f-58edfa8409c3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c" status: 200 len: 1303 microversion: 2.1 time: 0.140792 Jun 27 18:48:32.105590 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 212/414] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:31 2022] GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c => generated 1303 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:32.589309 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-c9a5c782-3855-420e-8674-f11654599d81 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:32.589938 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-c9a5c782-3855-420e-8674-f11654599d81 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:32.605500 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c9a5c782-3855-420e-8674-f11654599d81 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:32.606447 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c9a5c782-3855-420e-8674-f11654599d81 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:32.607416 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c9a5c782-3855-420e-8674-f11654599d81 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:32.608174 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c9a5c782-3855-420e-8674-f11654599d81 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:32.792357 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-c9a5c782-3855-420e-8674-f11654599d81 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:32.808450 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-c9a5c782-3855-420e-8674-f11654599d81 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.223382 Jun 27 18:48:32.809162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 203/415] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:32 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:33.122116 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f413ab38-4c27-4936-8ff8-86c5f82c32bf tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:33.123856 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f413ab38-4c27-4936-8ff8-86c5f82c32bf tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: b5dec71a-e9a3-43b2-9081-263a3275847c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:33.131054 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f413ab38-4c27-4936-8ff8-86c5f82c32bf tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:33.131739 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f413ab38-4c27-4936-8ff8-86c5f82c32bf tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:33.132813 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f413ab38-4c27-4936-8ff8-86c5f82c32bf tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:33.134711 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f413ab38-4c27-4936-8ff8-86c5f82c32bf tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:33.152966 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-f413ab38-4c27-4936-8ff8-86c5f82c32bf tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] HTTP exception thrown: Instance b5dec71a-e9a3-43b2-9081-263a3275847c could not be found. Jun 27 18:48:33.155620 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f413ab38-4c27-4936-8ff8-86c5f82c32bf tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Request method failure captured: Jun 27 18:48:33.155620 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c HTTP/1.1 Jun 27 18:48:33.155620 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:48:33.155620 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:48:33.155620 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:48:33.155620 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:48:33.155620 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:48:33.155620 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:48:33.155620 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:48:33.155620 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:48:33.155620 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiuftmuXFFAdgSGuSbB1xabJR61xd_5m6-fcGxMPlFAl1WC7UddiBlGLuZJY683sstUH6KaDaokwqgLz7L219q-mED7lB8l3PXY3nVLQ1YyuGQNGf5VEC8-mIzkr-4fXqU-0OIQmoml1LX7X159rj66rhO6KBGk3zZGMXJ6y_d2i1jIyc Jun 27 18:48:33.155620 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:48:33.155620 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:48:33.155620 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:48:33.155620 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:48:33.155620 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:48:33.155620 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:48:33.155620 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: bc7a3d93a3a84224b7b23d93924f276f Jun 27 18:48:33.155620 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-VolumesActionsTest-1014368731 Jun 27 18:48:33.155620 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:48:33.155620 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:48:33.157228 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bc7a3d93a3a84224b7b23d93924f276f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bc7a3d93a3a84224b7b23d93924f276f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bc7a3d93a3a84224b7b23d93924f276f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bc7a3d93a3a84224b7b23d93924f276f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:48:33.157228 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-VolumesActionsTest-1014368731 Jun 27 18:48:33.157228 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: bc7a3d93a3a84224b7b23d93924f276f Jun 27 18:48:33.157228 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-VolumesActionsTest-1014368731 Jun 27 18:48:33.157228 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-VolumesActionsTest-1014368731-project Jun 27 18:48:33.157228 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:48:33.157228 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:48:33.157228 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: d3c1ad9da81f48c390ad82e10e44712d Jun 27 18:48:33.157228 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-VolumesActionsTest-1014368731-project Jun 27 18:48:33.157228 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: > Jun 27 18:48:33.157228 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Instance b5dec71a-e9a3-43b2-9081-263a3275847c could not be found. Jun 27 18:48:33.157228 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': 'b5dec71a-e9a3-43b2-9081-263a3275847c'} Jun 27 18:48:33.158009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:48:33.158009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:48:33.158009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:48:33.158009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:48:33.158009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:48:33.158009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:48:33.158009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:48:33.158009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:48:33.158009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:48:33.158009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:48:33.158009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5dec71a-e9a3-43b2-9081-263a3275847c could not be found. Jun 27 18:48:33.158009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:48:33.158009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:48:33.158009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:48:33.158009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:48:33.158009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:48:33.158009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:48:33.158009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:48:33.158009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:48:33.158009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:48:33.159746 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:48:33.159746 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:48:33.159746 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:48:33.159746 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:48:33.159746 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:48:33.159746 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:48:33.159746 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:48:33.159746 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5dec71a-e9a3-43b2-9081-263a3275847c could not be found. Jun 27 18:48:33.159746 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:48:33.159746 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:48:33.159746 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:48:33.159746 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:48:33.159746 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:48:33.159746 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:48:33.159746 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:48:33.159746 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:48:33.159746 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5dec71a-e9a3-43b2-9081-263a3275847c could not be found. Jun 27 18:48:33.159746 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:48:33.160818 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f413ab38-4c27-4936-8ff8-86c5f82c32bf tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Returning 404 to user: Instance b5dec71a-e9a3-43b2-9081-263a3275847c could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:48:33.160818 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f413ab38-4c27-4936-8ff8-86c5f82c32bf tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c" status: 404 len: 111 microversion: 2.1 time: 0.039850 Jun 27 18:48:33.169861 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 213/416] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:33 2022] GET /compute/v2.1/servers/b5dec71a-e9a3-43b2-9081-263a3275847c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:48:33.282554 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-f94247a7-cdb1-40c2-be24-87b19ef4bf96 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1560532254", "imageRef": "c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3", "flavorRef": "452", "networks": [{"uuid": "54b444a0-be0c-4187-a1dd-ddf34a53d1fb"}]}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:48:33.378260 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.network.neutron [None req-f94247a7-cdb1-40c2-be24-87b19ef4bf96 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] validate_networks() for [('54b444a0-be0c-4187-a1dd-ddf34a53d1fb', None, None, None, None, None)] {{(pid=124717) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 18:48:33.709830 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-0f68146d-0b27-401b-aad8-1f753c52ed96 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Action: 'create', calling method: .version_select at 0x7f701c23ea60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1706456981", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpg5hp+UxiTYF41u4hECE34Fdd6lV7iFvx0IMnaGGlsxQB/aQluizX2n+GoiBimuNjrLKYRfy5N2LP1pqfNVDR/Hq37y9rEbCWMhkUE2VjUHJnRODi3uLmo0Y1rGRVwEA=="}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:48:33.730247 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-0f68146d-0b27-401b-aad8-1f753c52ed96 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Getting quotas for project 61866ab089f04e9abfab3f6ce58cf6b8. Resources: {'key_pairs'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:48:33.748491 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-0f68146d-0b27-401b-aad8-1f753c52ed96 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Getting quotas for user 49ccbcfbd48642aabd74d789b1875dd3 and project 61866ab089f04e9abfab3f6ce58cf6b8. Resources: {'key_pairs'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:48:33.768197 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0f68146d-0b27-401b-aad8-1f753c52ed96 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [f4836ad4-7233-4afd-8c01-d78b169bec76] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 27 18:48:33.813530 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-f94247a7-cdb1-40c2-be24-87b19ef4bf96 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Flavor limits 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 18:48:33.814005 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-f94247a7-cdb1-40c2-be24-87b19ef4bf96 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Image limits 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 18:48:33.815070 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-f94247a7-cdb1-40c2-be24-87b19ef4bf96 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Flavor pref 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 18:48:33.815338 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-f94247a7-cdb1-40c2-be24-87b19ef4bf96 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Image pref 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 18:48:33.815765 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-f94247a7-cdb1-40c2-be24-87b19ef4bf96 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 18:48:33.828089 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f94247a7-cdb1-40c2-be24-87b19ef4bf96 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:33.828789 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f94247a7-cdb1-40c2-be24-87b19ef4bf96 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:33.829742 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f94247a7-cdb1-40c2-be24-87b19ef4bf96 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:33.830630 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f94247a7-cdb1-40c2-be24-87b19ef4bf96 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:33.855833 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-f94247a7-cdb1-40c2-be24-87b19ef4bf96 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Getting quotas for project bc7a3d93a3a84224b7b23d93924f276f. Resources: {'ram', 'cores', 'instances'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:48:33.860446 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-f94247a7-cdb1-40c2-be24-87b19ef4bf96 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Getting quotas for user d3c1ad9da81f48c390ad82e10e44712d and project bc7a3d93a3a84224b7b23d93924f276f. Resources: {'ram', 'cores', 'instances'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:48:33.871947 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-f94247a7-cdb1-40c2-be24-87b19ef4bf96 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Going to run 1 instances... {{(pid=124717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 18:48:33.874228 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-f94247a7-cdb1-40c2-be24-87b19ef4bf96 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 18:48:34.001992 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-f94247a7-cdb1-40c2-be24-87b19ef4bf96 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723313 Jun 27 18:48:34.002675 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 204/417] 10.222.0.15 () {60 vars in 1146 bytes} [Mon Jun 27 18:48:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 18:48:34.016981 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-138aca01-5a4f-4712-8aec-4f66ad5e6f10 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:34.017630 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-138aca01-5a4f-4712-8aec-4f66ad5e6f10 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:34.027393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-138aca01-5a4f-4712-8aec-4f66ad5e6f10 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:34.027847 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-138aca01-5a4f-4712-8aec-4f66ad5e6f10 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:34.028676 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-138aca01-5a4f-4712-8aec-4f66ad5e6f10 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:34.029055 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-138aca01-5a4f-4712-8aec-4f66ad5e6f10 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:34.187395 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-138aca01-5a4f-4712-8aec-4f66ad5e6f10 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:34.196480 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-138aca01-5a4f-4712-8aec-4f66ad5e6f10 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1502 microversion: 2.1 time: 0.192564 Jun 27 18:48:34.197063 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 205/418] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:34 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1502 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:34.201919 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-fb196519-9b23-4ba2-82ac-c9697562ee62 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:34.202853 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-fb196519-9b23-4ba2-82ac-c9697562ee62 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:34.260620 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-fb196519-9b23-4ba2-82ac-c9697562ee62 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:34.267717 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-fb196519-9b23-4ba2-82ac-c9697562ee62 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 200 len: 1214 microversion: 2.1 time: 0.069479 Jun 27 18:48:34.268287 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 206/419] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:34 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:34.273184 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-dbbaadb1-bd42-4615-be7b-404ab1a461b6 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "417fb2ca-1603-4ff1-a340-7ddebcde7c9b"}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:48:34.274362 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-dbbaadb1-bd42-4615-be7b-404ab1a461b6 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:34.284016 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-dbbaadb1-bd42-4615-be7b-404ab1a461b6 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:34.284016 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-dbbaadb1-bd42-4615-be7b-404ab1a461b6 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:34.284016 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-dbbaadb1-bd42-4615-be7b-404ab1a461b6 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:34.284016 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-dbbaadb1-bd42-4615-be7b-404ab1a461b6 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:34.287223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:48:34.306308 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-dbbaadb1-bd42-4615-be7b-404ab1a461b6 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] HTTP exception thrown: Cannot 'attach_volume' instance 657439fb-0239-40b2-9be0-56c5b7dc558c while it is in vm_state rescued Jun 27 18:48:34.308488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-dbbaadb1-bd42-4615-be7b-404ab1a461b6 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Request method failure captured: Jun 27 18:48:34.308488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: POST /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c/os-volume_attachments HTTP/1.1 Jun 27 18:48:34.308488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 18:48:34.308488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 18:48:34.308488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 18:48:34.308488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 74 Jun 27 18:48:34.308488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 18:48:34.308488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 18:48:34.308488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 18:48:34.308488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 18:48:34.308488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufsgqlfv0hokCGUzepT1sutv3Om-w7VtAjx5eYoTAo_0yayA7H0lYzDj9boJX55FFsz4iaATtEf3QM_KAP0BkgCG_RMrK4v_pqEJJ5CyFPTwrTDg7mKbtZ6U0_Z0If7SY0B3k10FTMIMODcd34kBHuKTGz4_2o3EkBt1a5nCDWDysYk Jun 27 18:48:34.308488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 18:48:34.308488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 18:48:34.308488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 18:48:34.308488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 18:48:34.308488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 18:48:34.308488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 18:48:34.308488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: e03ab1e3fbe7445da087c631d8af557b Jun 27 18:48:34.308488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1545486903 Jun 27 18:48:34.308488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 18:48:34.308488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 18:48:34.310077 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e03ab1e3fbe7445da087c631d8af557b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e03ab1e3fbe7445da087c631d8af557b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e03ab1e3fbe7445da087c631d8af557b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e03ab1e3fbe7445da087c631d8af557b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:48:34.310077 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1545486903 Jun 27 18:48:34.310077 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: e03ab1e3fbe7445da087c631d8af557b Jun 27 18:48:34.310077 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1545486903 Jun 27 18:48:34.310077 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-ServerRescueNegativeTestJSON-1545486903-project Jun 27 18:48:34.310077 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 18:48:34.310077 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 18:48:34.310077 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: 78b6599200a94a2a8bcc0149dc22944d Jun 27 18:48:34.310077 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1545486903-project Jun 27 18:48:34.310077 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Jun 27 18:48:34.310077 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {"volumeAttachment": {"volumeId": "417fb2ca-1603-4ff1-a340-7ddebcde7c9b"}} Jun 27 18:48:34.310077 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: > Jun 27 18:48:34.311068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Cannot 'attach_volume' instance 657439fb-0239-40b2-9be0-56c5b7dc558c while it is in vm_state rescued Jun 27 18:48:34.311068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'server_id': '657439fb-0239-40b2-9be0-56c5b7dc558c', 'body': {'volumeAttachment': {'volumeId': '417fb2ca-1603-4ff1-a340-7ddebcde7c9b'}}} Jun 27 18:48:34.311068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:48:34.311068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:48:34.311068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 27 18:48:34.311068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 27 18:48:34.311068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 18:48:34.311068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 18:48:34.311068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 27 18:48:34.311068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 27 18:48:34.311068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 657439fb-0239-40b2-9be0-56c5b7dc558c in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 27 18:48:34.311068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:48:34.311068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:48:34.311068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:48:34.311068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:48:34.311068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:48:34.311068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:48:34.311068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:48:34.311068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:48:34.312471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:48:34.312471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:48:34.312471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 18:48:34.312471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 18:48:34.312471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 18:48:34.312471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 18:48:34.312471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 18:48:34.312471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 18:48:34.312471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 27 18:48:34.312471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 27 18:48:34.312471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 27 18:48:34.312471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 27 18:48:34.312471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 657439fb-0239-40b2-9be0-56c5b7dc558c while it is in vm_state rescued Jun 27 18:48:34.312471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:48:34.312471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:48:34.312471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:48:34.312471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:48:34.312471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:48:34.312471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:48:34.313797 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:48:34.313797 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:48:34.313797 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 657439fb-0239-40b2-9be0-56c5b7dc558c while it is in vm_state rescued Jun 27 18:48:34.313797 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:48:34.313797 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-dbbaadb1-bd42-4615-be7b-404ab1a461b6 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Returning 409 to user: Cannot 'attach_volume' instance 657439fb-0239-40b2-9be0-56c5b7dc558c while it is in vm_state rescued {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:48:34.313797 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-dbbaadb1-bd42-4615-be7b-404ab1a461b6 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "POST /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040349 Jun 27 18:48:34.313797 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 207/420] 10.222.0.15 () {60 vars in 1322 bytes} [Mon Jun 27 18:48:34 2022] POST /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 27 18:48:34.318119 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-90152772-2e68-4789-92b0-1b4f4359d115 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:48:34.318677 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-90152772-2e68-4789-92b0-1b4f4359d115 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:34.324893 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-90152772-2e68-4789-92b0-1b4f4359d115 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:34.325350 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-90152772-2e68-4789-92b0-1b4f4359d115 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:34.326181 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-90152772-2e68-4789-92b0-1b4f4359d115 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:34.326859 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-90152772-2e68-4789-92b0-1b4f4359d115 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:34.583921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-90152772-2e68-4789-92b0-1b4f4359d115 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "POST /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c/action" status: 202 len: 0 microversion: 2.1 time: 0.269184 Jun 27 18:48:34.584553 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 208/421] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Jun 27 18:48:34 2022] POST /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 18:48:34.596912 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-2284c374-b41e-437e-9bed-8670f12d417e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:34.597661 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-2284c374-b41e-437e-9bed-8670f12d417e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:34.605625 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2284c374-b41e-437e-9bed-8670f12d417e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:34.607677 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2284c374-b41e-437e-9bed-8670f12d417e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:34.608782 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2284c374-b41e-437e-9bed-8670f12d417e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:34.609741 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2284c374-b41e-437e-9bed-8670f12d417e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:34.736880 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 18:48:34.737079 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Mon Jun 27 18:48:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c (ip 10.222.0.15) !!! Jun 27 18:48:34.780379 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO oslo.messaging._drivers.impl_rabbit [None req-0f68146d-0b27-401b-aad8-1f753c52ed96 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [f4836ad4-7233-4afd-8c01-d78b169bec76] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 58498. Jun 27 18:48:34.790625 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-2284c374-b41e-437e-9bed-8670f12d417e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:34.798240 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-2284c374-b41e-437e-9bed-8670f12d417e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1510 microversion: 2.1 time: 0.207902 Jun 27 18:48:34.798892 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 209/422] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:34 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1510 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:48:34.853713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-0f68146d-0b27-401b-aad8-1f753c52ed96 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.368614 Jun 27 18:48:34.854714 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 214/423] 10.222.0.15 () {60 vars in 1158 bytes} [Mon Jun 27 18:48:33 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:48:35.285643 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-57d57f5f-50f6-4cd0-88ed-23f3ec8a4b27 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:35.286320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-57d57f5f-50f6-4cd0-88ed-23f3ec8a4b27 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:35.294287 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-57d57f5f-50f6-4cd0-88ed-23f3ec8a4b27 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:35.296186 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-57d57f5f-50f6-4cd0-88ed-23f3ec8a4b27 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:35.296186 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-57d57f5f-50f6-4cd0-88ed-23f3ec8a4b27 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:35.296186 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-57d57f5f-50f6-4cd0-88ed-23f3ec8a4b27 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:35.362418 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-57d57f5f-50f6-4cd0-88ed-23f3ec8a4b27 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:35.371402 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-57d57f5f-50f6-4cd0-88ed-23f3ec8a4b27 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 200 len: 1210 microversion: 2.1 time: 0.090321 Jun 27 18:48:35.371975 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 210/424] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:35 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:35.825896 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-2b7bb239-2f1a-4d9b-8fdb-c7c217ae54c3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:35.825896 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-2b7bb239-2f1a-4d9b-8fdb-c7c217ae54c3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:35.832810 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2b7bb239-2f1a-4d9b-8fdb-c7c217ae54c3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:35.833840 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2b7bb239-2f1a-4d9b-8fdb-c7c217ae54c3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:35.835456 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2b7bb239-2f1a-4d9b-8fdb-c7c217ae54c3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:35.836396 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2b7bb239-2f1a-4d9b-8fdb-c7c217ae54c3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:35.994896 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-2b7bb239-2f1a-4d9b-8fdb-c7c217ae54c3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:36.002592 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-2b7bb239-2f1a-4d9b-8fdb-c7c217ae54c3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1510 microversion: 2.1 time: 0.190443 Jun 27 18:48:36.003168 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 215/425] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:35 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1510 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:48:36.391942 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-b11d722d-12f0-4f89-9abe-b16f709635dc tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:36.392519 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-b11d722d-12f0-4f89-9abe-b16f709635dc tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:36.400084 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b11d722d-12f0-4f89-9abe-b16f709635dc tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:36.400544 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b11d722d-12f0-4f89-9abe-b16f709635dc tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:36.401321 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b11d722d-12f0-4f89-9abe-b16f709635dc tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:36.401751 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b11d722d-12f0-4f89-9abe-b16f709635dc tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:36.480352 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-b11d722d-12f0-4f89-9abe-b16f709635dc tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:36.487887 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-b11d722d-12f0-4f89-9abe-b16f709635dc tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 200 len: 1266 microversion: 2.1 time: 0.100499 Jun 27 18:48:36.488455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 211/426] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:36 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:37.019626 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-6363ebb4-b3dc-448c-9739-8b8ba24d9e07 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:37.024543 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-6363ebb4-b3dc-448c-9739-8b8ba24d9e07 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:37.031731 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6363ebb4-b3dc-448c-9739-8b8ba24d9e07 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:37.032181 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6363ebb4-b3dc-448c-9739-8b8ba24d9e07 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:37.032959 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6363ebb4-b3dc-448c-9739-8b8ba24d9e07 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:37.033394 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6363ebb4-b3dc-448c-9739-8b8ba24d9e07 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:37.196431 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-6363ebb4-b3dc-448c-9739-8b8ba24d9e07 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:37.205871 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-6363ebb4-b3dc-448c-9739-8b8ba24d9e07 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1510 microversion: 2.1 time: 0.188578 Jun 27 18:48:37.205871 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 216/427] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:37 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1510 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:37.505293 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-94aeed9c-5974-432e-b3bc-23be89e1391a tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:37.506662 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-94aeed9c-5974-432e-b3bc-23be89e1391a tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:37.526673 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-94aeed9c-5974-432e-b3bc-23be89e1391a tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:37.526673 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-94aeed9c-5974-432e-b3bc-23be89e1391a tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:37.526673 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-94aeed9c-5974-432e-b3bc-23be89e1391a tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:37.526673 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-94aeed9c-5974-432e-b3bc-23be89e1391a tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:37.628729 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-94aeed9c-5974-432e-b3bc-23be89e1391a tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:37.637893 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-94aeed9c-5974-432e-b3bc-23be89e1391a tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 200 len: 1266 microversion: 2.1 time: 0.136266 Jun 27 18:48:37.638969 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 212/428] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:37 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:38.221288 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-9722859b-e281-48ec-bb38-c0a411bf516d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:38.222705 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-9722859b-e281-48ec-bb38-c0a411bf516d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:38.230013 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9722859b-e281-48ec-bb38-c0a411bf516d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:38.230484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9722859b-e281-48ec-bb38-c0a411bf516d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:38.231433 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9722859b-e281-48ec-bb38-c0a411bf516d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:38.232185 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9722859b-e281-48ec-bb38-c0a411bf516d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:38.404658 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-9722859b-e281-48ec-bb38-c0a411bf516d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:38.412298 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-9722859b-e281-48ec-bb38-c0a411bf516d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1516 microversion: 2.1 time: 0.195094 Jun 27 18:48:38.412869 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 217/429] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:38 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1516 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:38.655297 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-4513f4a2-a07e-42df-84fd-e7957deabee3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:38.656239 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-4513f4a2-a07e-42df-84fd-e7957deabee3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:38.662879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4513f4a2-a07e-42df-84fd-e7957deabee3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:38.663311 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4513f4a2-a07e-42df-84fd-e7957deabee3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:38.664082 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4513f4a2-a07e-42df-84fd-e7957deabee3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:38.664493 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4513f4a2-a07e-42df-84fd-e7957deabee3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:38.726514 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-4513f4a2-a07e-42df-84fd-e7957deabee3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:38.739569 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-4513f4a2-a07e-42df-84fd-e7957deabee3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 200 len: 1274 microversion: 2.1 time: 0.083320 Jun 27 18:48:38.739569 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 213/430] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:38 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:39.751766 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7e4b818e-fe49-47ae-99d0-9a7989d5431f tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:39.752287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-7e4b818e-fe49-47ae-99d0-9a7989d5431f tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:39.769610 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7e4b818e-fe49-47ae-99d0-9a7989d5431f tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:39.770056 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7e4b818e-fe49-47ae-99d0-9a7989d5431f tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:39.771065 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7e4b818e-fe49-47ae-99d0-9a7989d5431f tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:39.771802 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7e4b818e-fe49-47ae-99d0-9a7989d5431f tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:40.038540 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-7e4b818e-fe49-47ae-99d0-9a7989d5431f tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:40.052539 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-7e4b818e-fe49-47ae-99d0-9a7989d5431f tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 200 len: 1314 microversion: 2.1 time: 0.302634 Jun 27 18:48:40.057484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 218/431] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:39 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:40.108648 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-3344f8d0-0246-42a8-bfb7-79e5e04374a3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Action: 'create', calling method: .version_select at 0x7f700ffd7a60>, body: {"keypair": {"name": "tempest-keypair-942897981", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+j7/01+ANTvs8wBGkKx5gidI8g30y3JVDzo5IMXi4AZfZbQMePTqAPusBVTTH12haC00Vnt+SD6OBRAdGX0LwxmBEwdJKta8UiTTlrCnpF3rX0uScg5CstI8BOvIusRA=="}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:48:40.127145 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-3344f8d0-0246-42a8-bfb7-79e5e04374a3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Getting quotas for project e03ab1e3fbe7445da087c631d8af557b. Resources: {'key_pairs'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:48:40.131384 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-3344f8d0-0246-42a8-bfb7-79e5e04374a3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Getting quotas for user 78b6599200a94a2a8bcc0149dc22944d and project e03ab1e3fbe7445da087c631d8af557b. Resources: {'key_pairs'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:48:40.222060 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-3344f8d0-0246-42a8-bfb7-79e5e04374a3 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.117983 Jun 27 18:48:40.222700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 214/432] 10.222.0.15 () {60 vars in 1158 bytes} [Mon Jun 27 18:48:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:48:40.665678 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-ce04ed92-1c4a-424f-921b-274867882482 req-1ec9436f-3ed0-43d3-96d0-0f674c218cbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ea7c5b-dbe4-4239-970b-62001a2c0d95", "tag": "a19f9366-a373-4d5a-bc15-91acd3bd6281"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:48:40.678230 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-ce04ed92-1c4a-424f-921b-274867882482 req-1ec9436f-3ed0-43d3-96d0-0f674c218cbb service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:40.678685 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-ce04ed92-1c4a-424f-921b-274867882482 req-1ec9436f-3ed0-43d3-96d0-0f674c218cbb service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:40.700914 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-ce04ed92-1c4a-424f-921b-274867882482 req-1ec9436f-3ed0-43d3-96d0-0f674c218cbb service nova] Creating event network-changed:a19f9366-a373-4d5a-bc15-91acd3bd6281 for instance c8ea7c5b-dbe4-4239-970b-62001a2c0d95 on hv-cinder-84460 Jun 27 18:48:40.706688 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-ce04ed92-1c4a-424f-921b-274867882482 req-1ec9436f-3ed0-43d3-96d0-0f674c218cbb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045491 Jun 27 18:48:40.711927 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 219/433] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:48:41.074725 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-c6e0e4eb-8b2a-41d7-a4bc-aa54e1b08767 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:41.075270 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-c6e0e4eb-8b2a-41d7-a4bc-aa54e1b08767 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:41.081879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c6e0e4eb-8b2a-41d7-a4bc-aa54e1b08767 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:41.082545 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c6e0e4eb-8b2a-41d7-a4bc-aa54e1b08767 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:41.083521 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c6e0e4eb-8b2a-41d7-a4bc-aa54e1b08767 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:41.083964 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c6e0e4eb-8b2a-41d7-a4bc-aa54e1b08767 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:41.449579 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-c6e0e4eb-8b2a-41d7-a4bc-aa54e1b08767 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:41.457037 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-c6e0e4eb-8b2a-41d7-a4bc-aa54e1b08767 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 200 len: 1314 microversion: 2.1 time: 0.387007 Jun 27 18:48:41.457591 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 215/434] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:41 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:42.474190 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a57eb453-e1b9-40c1-9788-a1bab9fbf78c tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:42.474941 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a57eb453-e1b9-40c1-9788-a1bab9fbf78c tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:42.482698 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a57eb453-e1b9-40c1-9788-a1bab9fbf78c tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:42.483138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a57eb453-e1b9-40c1-9788-a1bab9fbf78c tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:42.483967 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a57eb453-e1b9-40c1-9788-a1bab9fbf78c tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:42.484393 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a57eb453-e1b9-40c1-9788-a1bab9fbf78c tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:42.619784 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a57eb453-e1b9-40c1-9788-a1bab9fbf78c tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:42.628525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a57eb453-e1b9-40c1-9788-a1bab9fbf78c tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 200 len: 1314 microversion: 2.1 time: 0.158602 Jun 27 18:48:42.629274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 220/435] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:42 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:42.896451 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-bee65f3a-cfdf-4eec-a9f8-cce0db6816ed tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1459045474", "imageRef": "c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f67bf90-aaaf-40ed-b8c3-5bdd36fb3e3d"}], "security_groups": [{"name": "tempest-securitygroup--93274099"}], "key_name": "tempest-keypair-942897981", "user_data": "}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:48:43.024776 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.network.neutron [None req-bee65f3a-cfdf-4eec-a9f8-cce0db6816ed tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] validate_networks() for [('2f67bf90-aaaf-40ed-b8c3-5bdd36fb3e3d', None, None, None, None, None)] {{(pid=124717) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 18:48:43.405859 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-bee65f3a-cfdf-4eec-a9f8-cce0db6816ed tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Flavor limits 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 18:48:43.406285 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-bee65f3a-cfdf-4eec-a9f8-cce0db6816ed tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Image limits 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 18:48:43.406789 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-bee65f3a-cfdf-4eec-a9f8-cce0db6816ed tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Flavor pref 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 18:48:43.407202 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-bee65f3a-cfdf-4eec-a9f8-cce0db6816ed tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Image pref 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 18:48:43.407622 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-bee65f3a-cfdf-4eec-a9f8-cce0db6816ed tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 18:48:43.416338 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bee65f3a-cfdf-4eec-a9f8-cce0db6816ed tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:43.416816 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bee65f3a-cfdf-4eec-a9f8-cce0db6816ed tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:43.417618 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bee65f3a-cfdf-4eec-a9f8-cce0db6816ed tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:43.418056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bee65f3a-cfdf-4eec-a9f8-cce0db6816ed tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:43.434942 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-bee65f3a-cfdf-4eec-a9f8-cce0db6816ed tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Getting quotas for project e03ab1e3fbe7445da087c631d8af557b. Resources: {'ram', 'cores', 'instances'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:48:43.439018 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-bee65f3a-cfdf-4eec-a9f8-cce0db6816ed tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Getting quotas for user 78b6599200a94a2a8bcc0149dc22944d and project e03ab1e3fbe7445da087c631d8af557b. Resources: {'ram', 'cores', 'instances'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:48:43.450798 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-bee65f3a-cfdf-4eec-a9f8-cce0db6816ed tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Going to run 1 instances... {{(pid=124717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 18:48:43.453063 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-bee65f3a-cfdf-4eec-a9f8-cce0db6816ed tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 18:48:43.585500 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-bee65f3a-cfdf-4eec-a9f8-cce0db6816ed tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.693478 Jun 27 18:48:43.586148 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 216/436] 10.222.0.15 () {60 vars in 1146 bytes} [Mon Jun 27 18:48:42 2022] POST /compute/v2.1/servers => generated 407 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 18:48:43.596586 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a70e7474-b468-4abf-b95a-ffb11cf44363 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:43.597205 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a70e7474-b468-4abf-b95a-ffb11cf44363 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:43.645168 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-494d271f-4fac-40a1-820a-1dc4d63217ed tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:43.645798 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-494d271f-4fac-40a1-820a-1dc4d63217ed tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:43.652515 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-494d271f-4fac-40a1-820a-1dc4d63217ed tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:43.653158 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-494d271f-4fac-40a1-820a-1dc4d63217ed tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:43.654128 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-494d271f-4fac-40a1-820a-1dc4d63217ed tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:43.654791 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-494d271f-4fac-40a1-820a-1dc4d63217ed tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:43.662034 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a70e7474-b468-4abf-b95a-ffb11cf44363 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:43.669789 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a70e7474-b468-4abf-b95a-ffb11cf44363 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1245 microversion: 2.1 time: 0.077327 Jun 27 18:48:43.670714 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 221/437] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:43 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1245 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:43.800692 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-494d271f-4fac-40a1-820a-1dc4d63217ed tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:43.809172 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-494d271f-4fac-40a1-820a-1dc4d63217ed tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 200 len: 1314 microversion: 2.1 time: 0.167939 Jun 27 18:48:43.809736 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 217/438] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:43 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:48:44.686637 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7f3680ae-9d6f-42ee-9b4d-d2dfbe180bb2 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:44.687287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-7f3680ae-9d6f-42ee-9b4d-d2dfbe180bb2 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:44.697507 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7f3680ae-9d6f-42ee-9b4d-d2dfbe180bb2 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:44.698099 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7f3680ae-9d6f-42ee-9b4d-d2dfbe180bb2 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:44.698952 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7f3680ae-9d6f-42ee-9b4d-d2dfbe180bb2 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:44.699391 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7f3680ae-9d6f-42ee-9b4d-d2dfbe180bb2 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:44.765888 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-7f3680ae-9d6f-42ee-9b4d-d2dfbe180bb2 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:44.768186 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:48:44.774740 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-7f3680ae-9d6f-42ee-9b4d-d2dfbe180bb2 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1249 microversion: 2.1 time: 0.091377 Jun 27 18:48:44.775313 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 222/439] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:44 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1249 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:44.825382 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-81e8ecef-b6d7-463a-b38c-09835e139c7a tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:44.826007 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-81e8ecef-b6d7-463a-b38c-09835e139c7a tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:44.833104 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-81e8ecef-b6d7-463a-b38c-09835e139c7a tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:44.833560 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-81e8ecef-b6d7-463a-b38c-09835e139c7a tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:44.834373 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-81e8ecef-b6d7-463a-b38c-09835e139c7a tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:44.834835 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-81e8ecef-b6d7-463a-b38c-09835e139c7a tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:44.974042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-81e8ecef-b6d7-463a-b38c-09835e139c7a tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:44.981988 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-81e8ecef-b6d7-463a-b38c-09835e139c7a tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 200 len: 1314 microversion: 2.1 time: 0.160928 Jun 27 18:48:44.982577 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 218/440] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:44 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:45.792622 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7d4469f2-4898-445b-9e49-d02cd04c5cf7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:45.821324 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-7d4469f2-4898-445b-9e49-d02cd04c5cf7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:45.821324 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7d4469f2-4898-445b-9e49-d02cd04c5cf7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:45.821324 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7d4469f2-4898-445b-9e49-d02cd04c5cf7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:45.821324 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7d4469f2-4898-445b-9e49-d02cd04c5cf7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:45.821788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7d4469f2-4898-445b-9e49-d02cd04c5cf7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:45.865960 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-7d4469f2-4898-445b-9e49-d02cd04c5cf7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:45.874370 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-7d4469f2-4898-445b-9e49-d02cd04c5cf7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1249 microversion: 2.1 time: 0.086644 Jun 27 18:48:46.016639 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 223/441] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:45 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:46.017991 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-28f7a877-3e81-43f5-9257-da9f56bee1cc tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:46.017991 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-28f7a877-3e81-43f5-9257-da9f56bee1cc tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:46.017991 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-28f7a877-3e81-43f5-9257-da9f56bee1cc tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:46.017991 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-28f7a877-3e81-43f5-9257-da9f56bee1cc tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:46.018645 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-28f7a877-3e81-43f5-9257-da9f56bee1cc tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:46.018645 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-28f7a877-3e81-43f5-9257-da9f56bee1cc tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:46.146190 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-28f7a877-3e81-43f5-9257-da9f56bee1cc tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:46.154961 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-28f7a877-3e81-43f5-9257-da9f56bee1cc tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 200 len: 1314 microversion: 2.1 time: 0.160637 Jun 27 18:48:46.155528 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 219/442] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:45 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:47.021251 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-84b1e7b8-6752-49cb-b1ff-a871b6c5fe81 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:47.021251 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-84b1e7b8-6752-49cb-b1ff-a871b6c5fe81 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:47.029020 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-84b1e7b8-6752-49cb-b1ff-a871b6c5fe81 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:47.029540 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-84b1e7b8-6752-49cb-b1ff-a871b6c5fe81 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:47.030377 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-84b1e7b8-6752-49cb-b1ff-a871b6c5fe81 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:47.030836 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-84b1e7b8-6752-49cb-b1ff-a871b6c5fe81 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:47.093969 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-84b1e7b8-6752-49cb-b1ff-a871b6c5fe81 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:47.101711 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-84b1e7b8-6752-49cb-b1ff-a871b6c5fe81 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1241 microversion: 2.1 time: 0.086370 Jun 27 18:48:47.102270 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 224/443] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:47 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:48:47.172022 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-67d78b46-431c-4fb8-ad89-0f1e0ae1e1b8 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:47.172865 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-67d78b46-431c-4fb8-ad89-0f1e0ae1e1b8 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:47.179520 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-67d78b46-431c-4fb8-ad89-0f1e0ae1e1b8 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:47.179963 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-67d78b46-431c-4fb8-ad89-0f1e0ae1e1b8 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:47.180722 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-67d78b46-431c-4fb8-ad89-0f1e0ae1e1b8 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:47.181156 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-67d78b46-431c-4fb8-ad89-0f1e0ae1e1b8 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:47.320831 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-67d78b46-431c-4fb8-ad89-0f1e0ae1e1b8 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:47.328549 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-67d78b46-431c-4fb8-ad89-0f1e0ae1e1b8 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 200 len: 1314 microversion: 2.1 time: 0.161207 Jun 27 18:48:47.329654 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 220/444] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:47 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:48.121271 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-bcdc02d5-ce11-4f93-83a7-aa3d220dff77 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:48.121996 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-bcdc02d5-ce11-4f93-83a7-aa3d220dff77 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:48.129042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bcdc02d5-ce11-4f93-83a7-aa3d220dff77 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:48.129488 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bcdc02d5-ce11-4f93-83a7-aa3d220dff77 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:48.130255 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bcdc02d5-ce11-4f93-83a7-aa3d220dff77 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:48.130715 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bcdc02d5-ce11-4f93-83a7-aa3d220dff77 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:48.195192 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-bcdc02d5-ce11-4f93-83a7-aa3d220dff77 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:48.203554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-bcdc02d5-ce11-4f93-83a7-aa3d220dff77 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1241 microversion: 2.1 time: 0.086897 Jun 27 18:48:48.204140 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 225/445] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:48 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:48.346611 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-ae00d97f-07f4-4e31-9656-e74dd88437a4 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:48.347277 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-ae00d97f-07f4-4e31-9656-e74dd88437a4 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:48.354776 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ae00d97f-07f4-4e31-9656-e74dd88437a4 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:48.355482 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ae00d97f-07f4-4e31-9656-e74dd88437a4 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:48.356260 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ae00d97f-07f4-4e31-9656-e74dd88437a4 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:48.356699 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ae00d97f-07f4-4e31-9656-e74dd88437a4 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:48.489575 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-ae00d97f-07f4-4e31-9656-e74dd88437a4 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:48.498047 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-ae00d97f-07f4-4e31-9656-e74dd88437a4 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 200 len: 1314 microversion: 2.1 time: 0.155501 Jun 27 18:48:48.498640 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 221/446] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:48 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:49.220930 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-d55323cb-5f47-4c55-8b4e-301f1bc43899 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:49.221552 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-d55323cb-5f47-4c55-8b4e-301f1bc43899 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:49.230719 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d55323cb-5f47-4c55-8b4e-301f1bc43899 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:49.231197 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d55323cb-5f47-4c55-8b4e-301f1bc43899 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:49.232006 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d55323cb-5f47-4c55-8b4e-301f1bc43899 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:49.232444 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d55323cb-5f47-4c55-8b4e-301f1bc43899 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:49.298571 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-d55323cb-5f47-4c55-8b4e-301f1bc43899 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:49.306300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-d55323cb-5f47-4c55-8b4e-301f1bc43899 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1297 microversion: 2.1 time: 0.089635 Jun 27 18:48:49.307818 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 226/447] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:49 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1297 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:49.515461 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e92e8d3b-12ab-4329-af12-263b61a0f0a2 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:49.516118 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e92e8d3b-12ab-4329-af12-263b61a0f0a2 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:49.522427 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e92e8d3b-12ab-4329-af12-263b61a0f0a2 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:49.522874 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e92e8d3b-12ab-4329-af12-263b61a0f0a2 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:49.523626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e92e8d3b-12ab-4329-af12-263b61a0f0a2 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:49.524053 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e92e8d3b-12ab-4329-af12-263b61a0f0a2 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:49.663452 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-e92e8d3b-12ab-4329-af12-263b61a0f0a2 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:49.671146 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e92e8d3b-12ab-4329-af12-263b61a0f0a2 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 200 len: 1314 microversion: 2.1 time: 0.159545 Jun 27 18:48:49.671718 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 222/448] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:49 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:50.327479 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-c04e8c6a-4fe7-4354-85f7-55b5913145cc tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:50.328093 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-c04e8c6a-4fe7-4354-85f7-55b5913145cc tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:50.335934 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c04e8c6a-4fe7-4354-85f7-55b5913145cc tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:50.338347 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c04e8c6a-4fe7-4354-85f7-55b5913145cc tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:50.338347 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c04e8c6a-4fe7-4354-85f7-55b5913145cc tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:50.338347 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c04e8c6a-4fe7-4354-85f7-55b5913145cc tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:50.445483 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c04e8c6a-4fe7-4354-85f7-55b5913145cc tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:50.453906 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-c04e8c6a-4fe7-4354-85f7-55b5913145cc tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1303 microversion: 2.1 time: 0.132939 Jun 27 18:48:50.455094 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 227/449] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:50 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1303 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:50.689687 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-89c5e76d-b6a2-475c-9cd5-8d3096ad8963 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:50.691054 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-89c5e76d-b6a2-475c-9cd5-8d3096ad8963 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:50.699477 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-89c5e76d-b6a2-475c-9cd5-8d3096ad8963 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:50.700181 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-89c5e76d-b6a2-475c-9cd5-8d3096ad8963 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:50.700972 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-89c5e76d-b6a2-475c-9cd5-8d3096ad8963 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:50.701412 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-89c5e76d-b6a2-475c-9cd5-8d3096ad8963 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:50.969660 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-89c5e76d-b6a2-475c-9cd5-8d3096ad8963 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:50.978204 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-89c5e76d-b6a2-475c-9cd5-8d3096ad8963 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 200 len: 1314 microversion: 2.1 time: 0.292912 Jun 27 18:48:50.979193 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 223/450] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:50 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:51.058870 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-073c5026-8242-4cb0-b652-3e142cc8ee08 req-a061fd97-e66e-43c7-abde-831fd0330f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ea7c5b-dbe4-4239-970b-62001a2c0d95", "name": "network-vif-plugged", "status": "completed", "tag": "a19f9366-a373-4d5a-bc15-91acd3bd6281"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:48:51.067618 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-073c5026-8242-4cb0-b652-3e142cc8ee08 req-a061fd97-e66e-43c7-abde-831fd0330f3a service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:51.068060 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-073c5026-8242-4cb0-b652-3e142cc8ee08 req-a061fd97-e66e-43c7-abde-831fd0330f3a service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:51.082000 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-073c5026-8242-4cb0-b652-3e142cc8ee08 req-a061fd97-e66e-43c7-abde-831fd0330f3a service nova] Creating event network-vif-plugged:a19f9366-a373-4d5a-bc15-91acd3bd6281 for instance c8ea7c5b-dbe4-4239-970b-62001a2c0d95 on hv-cinder-84460 Jun 27 18:48:51.087289 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-073c5026-8242-4cb0-b652-3e142cc8ee08 req-a061fd97-e66e-43c7-abde-831fd0330f3a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032879 Jun 27 18:48:51.087979 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 228/451] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:48:51.474455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-9a83fb76-b0c2-4514-949b-f8a83ec2c6b9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:51.475226 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-9a83fb76-b0c2-4514-949b-f8a83ec2c6b9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:51.483425 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9a83fb76-b0c2-4514-949b-f8a83ec2c6b9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:51.483874 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9a83fb76-b0c2-4514-949b-f8a83ec2c6b9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:51.484649 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9a83fb76-b0c2-4514-949b-f8a83ec2c6b9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:51.485275 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9a83fb76-b0c2-4514-949b-f8a83ec2c6b9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:51.682720 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-9a83fb76-b0c2-4514-949b-f8a83ec2c6b9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:51.685170 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:48:51.693065 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-9a83fb76-b0c2-4514-949b-f8a83ec2c6b9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1369 microversion: 2.1 time: 0.220521 Jun 27 18:48:51.693065 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 224/452] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:51 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1369 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:51.817803 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-70129717-90f1-468c-ad53-fd1499cfed52 req-d52d7ab1-bbd6-4d3a-823f-5670cbb0f58c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c18b111d-f2de-41ac-8ae4-6738845259fb", "tag": "e7f919f9-9aa0-4ce8-a9d5-eaf1aec06292"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:48:51.827439 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-70129717-90f1-468c-ad53-fd1499cfed52 req-d52d7ab1-bbd6-4d3a-823f-5670cbb0f58c service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:51.827880 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-70129717-90f1-468c-ad53-fd1499cfed52 req-d52d7ab1-bbd6-4d3a-823f-5670cbb0f58c service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:51.841965 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-70129717-90f1-468c-ad53-fd1499cfed52 req-d52d7ab1-bbd6-4d3a-823f-5670cbb0f58c service nova] Creating event network-changed:e7f919f9-9aa0-4ce8-a9d5-eaf1aec06292 for instance c18b111d-f2de-41ac-8ae4-6738845259fb on hv-cinder-84460 Jun 27 18:48:51.847077 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-70129717-90f1-468c-ad53-fd1499cfed52 req-d52d7ab1-bbd6-4d3a-823f-5670cbb0f58c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033217 Jun 27 18:48:51.847881 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 229/453] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:48:51.996556 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-1e3e77af-e0a4-40c2-a542-d05c68358a54 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:51.997182 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-1e3e77af-e0a4-40c2-a542-d05c68358a54 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:52.004367 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1e3e77af-e0a4-40c2-a542-d05c68358a54 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:52.004758 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1e3e77af-e0a4-40c2-a542-d05c68358a54 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:52.005515 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1e3e77af-e0a4-40c2-a542-d05c68358a54 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:52.005952 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1e3e77af-e0a4-40c2-a542-d05c68358a54 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:52.140063 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-1e3e77af-e0a4-40c2-a542-d05c68358a54 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:52.147394 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-1e3e77af-e0a4-40c2-a542-d05c68358a54 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 200 len: 1314 microversion: 2.1 time: 0.155765 Jun 27 18:48:52.147961 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 225/454] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:51 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:48:52.709312 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-6d7e9e9a-d27e-4ddf-9955-beb492344246 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:52.715549 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-6d7e9e9a-d27e-4ddf-9955-beb492344246 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:52.716996 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6d7e9e9a-d27e-4ddf-9955-beb492344246 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:52.717445 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6d7e9e9a-d27e-4ddf-9955-beb492344246 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:52.718208 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6d7e9e9a-d27e-4ddf-9955-beb492344246 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:52.718686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6d7e9e9a-d27e-4ddf-9955-beb492344246 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:52.846968 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-6d7e9e9a-d27e-4ddf-9955-beb492344246 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:52.855131 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-6d7e9e9a-d27e-4ddf-9955-beb492344246 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1369 microversion: 2.1 time: 0.150169 Jun 27 18:48:52.855951 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 230/455] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:52 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:53.164344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-754763ee-2ef7-4341-9472-0d14b639b925 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:53.164969 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-754763ee-2ef7-4341-9472-0d14b639b925 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:53.172278 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-754763ee-2ef7-4341-9472-0d14b639b925 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:53.172735 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-754763ee-2ef7-4341-9472-0d14b639b925 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:53.173537 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-754763ee-2ef7-4341-9472-0d14b639b925 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:53.173980 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-754763ee-2ef7-4341-9472-0d14b639b925 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:53.307251 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-754763ee-2ef7-4341-9472-0d14b639b925 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:53.314742 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-754763ee-2ef7-4341-9472-0d14b639b925 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 200 len: 1314 microversion: 2.1 time: 0.154231 Jun 27 18:48:53.315310 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 226/456] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:53 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:53.871715 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a7cc862c-bf33-47b8-a4e4-5e5d345a5299 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:53.872332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a7cc862c-bf33-47b8-a4e4-5e5d345a5299 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:53.874281 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=6 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:48:53.879816 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a7cc862c-bf33-47b8-a4e4-5e5d345a5299 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:53.883724 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a7cc862c-bf33-47b8-a4e4-5e5d345a5299 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:53.883724 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a7cc862c-bf33-47b8-a4e4-5e5d345a5299 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:53.883724 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a7cc862c-bf33-47b8-a4e4-5e5d345a5299 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:54.013564 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a7cc862c-bf33-47b8-a4e4-5e5d345a5299 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:54.020874 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a7cc862c-bf33-47b8-a4e4-5e5d345a5299 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1369 microversion: 2.1 time: 0.153077 Jun 27 18:48:54.021423 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 231/457] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:53 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:54.331418 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e472adb4-30a6-4ddc-9034-2669ecddb964 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:54.332069 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e472adb4-30a6-4ddc-9034-2669ecddb964 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:54.333895 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell0:SELECT=4 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:48:54.334595 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell0:SELECT=18 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:48:54.335725 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:48:54.341222 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e472adb4-30a6-4ddc-9034-2669ecddb964 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:54.341666 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e472adb4-30a6-4ddc-9034-2669ecddb964 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:54.345639 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e472adb4-30a6-4ddc-9034-2669ecddb964 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:54.345639 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e472adb4-30a6-4ddc-9034-2669ecddb964 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:54.353389 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-38001318-68bf-4a93-aced-eebbc25e8b21 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:54.354549 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-38001318-68bf-4a93-aced-eebbc25e8b21 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:54.360952 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-38001318-68bf-4a93-aced-eebbc25e8b21 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:54.361405 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-38001318-68bf-4a93-aced-eebbc25e8b21 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:54.362203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-38001318-68bf-4a93-aced-eebbc25e8b21 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:54.362949 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-38001318-68bf-4a93-aced-eebbc25e8b21 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:54.491103 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-e472adb4-30a6-4ddc-9034-2669ecddb964 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:54.497339 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e472adb4-30a6-4ddc-9034-2669ecddb964 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 200 len: 1314 microversion: 2.1 time: 0.170117 Jun 27 18:48:54.497568 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.objects.instance [None req-38001318-68bf-4a93-aced-eebbc25e8b21 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lazy-loading 'services' on Instance uuid bd4240ca-4c5b-441f-b4f3-659defed4c91 {{(pid=124716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:48:54.498483 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 227/458] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:54 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:54.742410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-38001318-68bf-4a93-aced-eebbc25e8b21 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91/os-volume_attachments/de74325f-36c3-4822-aaf8-75c7ab3b5f59" status: 202 len: 0 microversion: 2.1 time: 0.392567 Jun 27 18:48:54.747291 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 232/459] 10.222.0.15 () {58 vars in 1415 bytes} [Mon Jun 27 18:48:54 2022] DELETE /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91/os-volume_attachments/de74325f-36c3-4822-aaf8-75c7ab3b5f59 => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 18:48:55.037632 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-aebf281e-bcb1-4916-ab65-3a2748c5a911 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:55.038178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-aebf281e-bcb1-4916-ab65-3a2748c5a911 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:55.044826 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-aebf281e-bcb1-4916-ab65-3a2748c5a911 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:55.045279 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-aebf281e-bcb1-4916-ab65-3a2748c5a911 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:55.046042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-aebf281e-bcb1-4916-ab65-3a2748c5a911 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:55.046509 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-aebf281e-bcb1-4916-ab65-3a2748c5a911 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:55.175699 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-aebf281e-bcb1-4916-ab65-3a2748c5a911 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:55.183734 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-aebf281e-bcb1-4916-ab65-3a2748c5a911 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1369 microversion: 2.1 time: 0.150533 Jun 27 18:48:55.184300 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 228/460] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:55 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:55.516481 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-fd0b4810-5348-4796-b5d9-360f4dc5e069 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:55.518502 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-fd0b4810-5348-4796-b5d9-360f4dc5e069 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:55.523748 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd0b4810-5348-4796-b5d9-360f4dc5e069 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:55.524202 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd0b4810-5348-4796-b5d9-360f4dc5e069 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:55.524956 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd0b4810-5348-4796-b5d9-360f4dc5e069 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:55.525389 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd0b4810-5348-4796-b5d9-360f4dc5e069 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:55.659265 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-fd0b4810-5348-4796-b5d9-360f4dc5e069 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:55.666742 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-fd0b4810-5348-4796-b5d9-360f4dc5e069 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 200 len: 1314 microversion: 2.1 time: 0.154553 Jun 27 18:48:55.669509 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 233/461] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:55 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:56.207740 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-8659cda6-8808-4108-9ac7-eee2fd72f3af tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:56.207740 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-8659cda6-8808-4108-9ac7-eee2fd72f3af tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:56.208425 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8659cda6-8808-4108-9ac7-eee2fd72f3af tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:56.208548 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8659cda6-8808-4108-9ac7-eee2fd72f3af tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:56.209219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8659cda6-8808-4108-9ac7-eee2fd72f3af tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:56.209649 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8659cda6-8808-4108-9ac7-eee2fd72f3af tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:56.340780 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-8659cda6-8808-4108-9ac7-eee2fd72f3af tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:56.348179 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-8659cda6-8808-4108-9ac7-eee2fd72f3af tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1369 microversion: 2.1 time: 0.151967 Jun 27 18:48:56.348737 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 229/462] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:56 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:56.684140 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-8e84ab14-13d0-418e-aae6-319931caecbe tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:56.684760 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-8e84ab14-13d0-418e-aae6-319931caecbe tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:56.691364 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8e84ab14-13d0-418e-aae6-319931caecbe tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:56.691809 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8e84ab14-13d0-418e-aae6-319931caecbe tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:56.692562 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8e84ab14-13d0-418e-aae6-319931caecbe tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:56.692993 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8e84ab14-13d0-418e-aae6-319931caecbe tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:56.826616 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-8e84ab14-13d0-418e-aae6-319931caecbe tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:56.833993 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-8e84ab14-13d0-418e-aae6-319931caecbe tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 200 len: 1498 microversion: 2.1 time: 0.153939 Jun 27 18:48:56.836409 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 234/463] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:56 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 1498 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:57.372844 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-16ad9468-ece1-4811-a2c1-d40ccb53d62b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:57.373540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-16ad9468-ece1-4811-a2c1-d40ccb53d62b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:57.380155 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-16ad9468-ece1-4811-a2c1-d40ccb53d62b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:57.385605 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-16ad9468-ece1-4811-a2c1-d40ccb53d62b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:57.385605 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-16ad9468-ece1-4811-a2c1-d40ccb53d62b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:57.385605 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-16ad9468-ece1-4811-a2c1-d40ccb53d62b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:57.519266 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-16ad9468-ece1-4811-a2c1-d40ccb53d62b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:57.527131 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-16ad9468-ece1-4811-a2c1-d40ccb53d62b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1369 microversion: 2.1 time: 0.158906 Jun 27 18:48:57.528030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 230/464] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:57 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:57.990500 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-44a30b20-15b4-45a8-831b-f62ad55628c5 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:57.990988 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-44a30b20-15b4-45a8-831b-f62ad55628c5 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:57.997723 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-44a30b20-15b4-45a8-831b-f62ad55628c5 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:57.998177 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-44a30b20-15b4-45a8-831b-f62ad55628c5 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:57.998955 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-44a30b20-15b4-45a8-831b-f62ad55628c5 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:57.999389 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-44a30b20-15b4-45a8-831b-f62ad55628c5 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:58.023942 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-44a30b20-15b4-45a8-831b-f62ad55628c5 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Going to try to terminate instance {{(pid=124716) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 18:48:58.291750 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-44a30b20-15b4-45a8-831b-f62ad55628c5 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 204 len: 0 microversion: 2.1 time: 0.304838 Jun 27 18:48:58.292750 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 235/465] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:48:57 2022] DELETE /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 18:48:58.300681 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-15bc7b04-f709-4a43-bb04-4f7fb08b77bc tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:58.301299 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-15bc7b04-f709-4a43-bb04-4f7fb08b77bc tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:58.307283 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-15bc7b04-f709-4a43-bb04-4f7fb08b77bc tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:58.307727 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-15bc7b04-f709-4a43-bb04-4f7fb08b77bc tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:58.308697 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-15bc7b04-f709-4a43-bb04-4f7fb08b77bc tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:58.309132 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-15bc7b04-f709-4a43-bb04-4f7fb08b77bc tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:58.441493 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-15bc7b04-f709-4a43-bb04-4f7fb08b77bc tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:58.449594 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-15bc7b04-f709-4a43-bb04-4f7fb08b77bc tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 200 len: 1504 microversion: 2.1 time: 0.152703 Jun 27 18:48:58.450169 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 231/466] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:58 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:58.480886 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-e0be021b-de80-432d-aebb-96e327806fa3 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:58.481460 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-e0be021b-de80-432d-aebb-96e327806fa3 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:58.487671 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e0be021b-de80-432d-aebb-96e327806fa3 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:58.488110 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e0be021b-de80-432d-aebb-96e327806fa3 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:58.488858 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e0be021b-de80-432d-aebb-96e327806fa3 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:58.489349 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e0be021b-de80-432d-aebb-96e327806fa3 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:58.543672 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-537b277b-20b9-4d89-94d4-79ebf9f9923e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:58.544285 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-537b277b-20b9-4d89-94d4-79ebf9f9923e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:58.550233 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-537b277b-20b9-4d89-94d4-79ebf9f9923e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:58.550718 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-537b277b-20b9-4d89-94d4-79ebf9f9923e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:58.551684 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-537b277b-20b9-4d89-94d4-79ebf9f9923e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:58.552123 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-537b277b-20b9-4d89-94d4-79ebf9f9923e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:58.574189 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.objects.instance [None req-e0be021b-de80-432d-aebb-96e327806fa3 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lazy-loading 'services' on Instance uuid ab81efbc-7e62-4405-a45a-5d8448895831 {{(pid=124716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:48:58.693424 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-537b277b-20b9-4d89-94d4-79ebf9f9923e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:58.702235 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-537b277b-20b9-4d89-94d4-79ebf9f9923e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1369 microversion: 2.1 time: 0.162513 Jun 27 18:48:58.702824 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 232/467] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:58 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1369 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:48:58.810909 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-e0be021b-de80-432d-aebb-96e327806fa3 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831/os-volume_attachments/587d2dcf-fd77-4cda-9c74-d9832dba0f1e" status: 202 len: 0 microversion: 2.1 time: 0.334440 Jun 27 18:48:58.811502 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 236/468] 10.222.0.15 () {58 vars in 1415 bytes} [Mon Jun 27 18:48:58 2022] DELETE /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831/os-volume_attachments/587d2dcf-fd77-4cda-9c74-d9832dba0f1e => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:48:59.019391 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-7ef5a5cb-0dbd-447a-87ef-2199a4246ad2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:48:59.025349 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7ef5a5cb-0dbd-447a-87ef-2199a4246ad2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:59.025795 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7ef5a5cb-0dbd-447a-87ef-2199a4246ad2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:59.048425 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-7ef5a5cb-0dbd-447a-87ef-2199a4246ad2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Going to try to stop instance {{(pid=124717) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 27 18:48:59.231394 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-7ef5a5cb-0dbd-447a-87ef-2199a4246ad2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "POST /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91/action" status: 202 len: 0 microversion: 2.1 time: 0.214691 Jun 27 18:48:59.232167 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 233/469] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Jun 27 18:48:59 2022] POST /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:48:59.241169 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-179d148f-8c92-48c7-b326-844c6b741b25 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:59.241874 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-179d148f-8c92-48c7-b326-844c6b741b25 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:59.248338 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-179d148f-8c92-48c7-b326-844c6b741b25 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:59.248788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-179d148f-8c92-48c7-b326-844c6b741b25 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:59.249561 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-179d148f-8c92-48c7-b326-844c6b741b25 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:59.250007 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-179d148f-8c92-48c7-b326-844c6b741b25 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:59.385222 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-179d148f-8c92-48c7-b326-844c6b741b25 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:59.387728 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:48:59.394080 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-179d148f-8c92-48c7-b326-844c6b741b25 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1722 microversion: 2.1 time: 0.157701 Jun 27 18:48:59.394684 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 237/470] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:59 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:59.467945 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-81dfd9ef-657d-403d-8d06-bbb245c91342 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:59.468701 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-81dfd9ef-657d-403d-8d06-bbb245c91342 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:59.475531 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-81dfd9ef-657d-403d-8d06-bbb245c91342 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:59.475975 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-81dfd9ef-657d-403d-8d06-bbb245c91342 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:59.476755 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-81dfd9ef-657d-403d-8d06-bbb245c91342 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:59.477195 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-81dfd9ef-657d-403d-8d06-bbb245c91342 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:59.614045 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-81dfd9ef-657d-403d-8d06-bbb245c91342 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:59.621653 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-81dfd9ef-657d-403d-8d06-bbb245c91342 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 200 len: 1504 microversion: 2.1 time: 0.158643 Jun 27 18:48:59.622552 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 234/471] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:59 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:48:59.679477 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-32291421-5287-4b66-8348-f28b55fa3269 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1361475925", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1706456981", "security_groups": [{"name": "tempest-secgroup-smoke-1795091937"}], "networks": [{"uuid": "139455ae-3384-4b5c-902f-02c2be0bb9bd"}], "block_device_mapping_v2": [{"uuid": "0e8d2551-bd7c-4b63-92dc-11cb5dc8ddf9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:48:59.688275 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:48:59.719784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-5bbfa466-ca2f-4170-a992-fe476f0fd5be tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:48:59.720400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-5bbfa466-ca2f-4170-a992-fe476f0fd5be tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:48:59.726409 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5bbfa466-ca2f-4170-a992-fe476f0fd5be tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:59.727248 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5bbfa466-ca2f-4170-a992-fe476f0fd5be tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:59.727611 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5bbfa466-ca2f-4170-a992-fe476f0fd5be tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:48:59.728043 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5bbfa466-ca2f-4170-a992-fe476f0fd5be tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:48:59.829430 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.network.neutron [None req-32291421-5287-4b66-8348-f28b55fa3269 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] validate_networks() for [('139455ae-3384-4b5c-902f-02c2be0bb9bd', None, None, None, None, None)] {{(pid=124716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 18:48:59.962946 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-5bbfa466-ca2f-4170-a992-fe476f0fd5be tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:48:59.973479 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-5bbfa466-ca2f-4170-a992-fe476f0fd5be tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1369 microversion: 2.1 time: 0.258090 Jun 27 18:48:59.974351 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 235/472] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:48:59 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1369 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:49:00.245177 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-32291421-5287-4b66-8348-f28b55fa3269 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Flavor limits 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 18:49:00.245863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-32291421-5287-4b66-8348-f28b55fa3269 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Image limits 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 18:49:00.246123 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-32291421-5287-4b66-8348-f28b55fa3269 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Flavor pref 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 18:49:00.246500 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-32291421-5287-4b66-8348-f28b55fa3269 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Image pref 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 18:49:00.246916 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-32291421-5287-4b66-8348-f28b55fa3269 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 18:49:00.256302 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-32291421-5287-4b66-8348-f28b55fa3269 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:00.261151 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-32291421-5287-4b66-8348-f28b55fa3269 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:00.261151 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-32291421-5287-4b66-8348-f28b55fa3269 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:00.261151 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-32291421-5287-4b66-8348-f28b55fa3269 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:00.275954 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-32291421-5287-4b66-8348-f28b55fa3269 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Getting quotas for project 61866ab089f04e9abfab3f6ce58cf6b8. Resources: {'ram', 'cores', 'instances'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:49:00.280933 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-32291421-5287-4b66-8348-f28b55fa3269 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Getting quotas for user 49ccbcfbd48642aabd74d789b1875dd3 and project 61866ab089f04e9abfab3f6ce58cf6b8. Resources: {'ram', 'cores', 'instances'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:49:00.339363 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-32291421-5287-4b66-8348-f28b55fa3269 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Going to run 1 instances... {{(pid=124716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 18:49:00.341506 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-32291421-5287-4b66-8348-f28b55fa3269 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0e8d2551-bd7c-4b63-92dc-11cb5dc8ddf9',volume_size=None,volume_type=None)] {{(pid=124716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 18:49:00.412430 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e154fe94-2a2e-4805-a6e2-c7d69d3eb813 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:00.412982 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e154fe94-2a2e-4805-a6e2-c7d69d3eb813 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:00.419480 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e154fe94-2a2e-4805-a6e2-c7d69d3eb813 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:00.419923 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e154fe94-2a2e-4805-a6e2-c7d69d3eb813 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:00.420749 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e154fe94-2a2e-4805-a6e2-c7d69d3eb813 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:00.421184 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e154fe94-2a2e-4805-a6e2-c7d69d3eb813 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:00.548647 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-e154fe94-2a2e-4805-a6e2-c7d69d3eb813 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:00.556530 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e154fe94-2a2e-4805-a6e2-c7d69d3eb813 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1676 microversion: 2.1 time: 0.148081 Jun 27 18:49:00.557094 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 236/473] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:00 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:00.639972 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-5e88831e-2674-478c-ad6b-877ddb995cc0 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:00.640822 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-5e88831e-2674-478c-ad6b-877ddb995cc0 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:00.647628 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5e88831e-2674-478c-ad6b-877ddb995cc0 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:00.648074 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5e88831e-2674-478c-ad6b-877ddb995cc0 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:00.648841 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5e88831e-2674-478c-ad6b-877ddb995cc0 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:00.649498 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5e88831e-2674-478c-ad6b-877ddb995cc0 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:00.731498 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-32291421-5287-4b66-8348-f28b55fa3269 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.054888 Jun 27 18:49:00.732357 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 238/474] 10.222.0.15 () {60 vars in 1146 bytes} [Mon Jun 27 18:48:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 18:49:00.754306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-208479f6-f85c-4643-add8-43f2148e259a tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:00.755134 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-208479f6-f85c-4643-add8-43f2148e259a tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:00.834211 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-208479f6-f85c-4643-add8-43f2148e259a tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:00.845665 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-208479f6-f85c-4643-add8-43f2148e259a tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1089 microversion: 2.1 time: 0.104233 Jun 27 18:49:00.851168 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 239/475] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:00 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1089 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:00.858650 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-5e88831e-2674-478c-ad6b-877ddb995cc0 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:00.867041 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-5e88831e-2674-478c-ad6b-877ddb995cc0 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 200 len: 1504 microversion: 2.1 time: 0.232458 Jun 27 18:49:00.867625 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 237/476] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:00 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 1504 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:49:00.991574 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-b0106701-f66b-435b-be04-327b38314c39 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:00.992312 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-b0106701-f66b-435b-be04-327b38314c39 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:00.999129 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b0106701-f66b-435b-be04-327b38314c39 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:00.999654 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b0106701-f66b-435b-be04-327b38314c39 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:01.000581 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b0106701-f66b-435b-be04-327b38314c39 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:01.001232 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b0106701-f66b-435b-be04-327b38314c39 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:01.157559 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-b0106701-f66b-435b-be04-327b38314c39 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:01.168061 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-b0106701-f66b-435b-be04-327b38314c39 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1369 microversion: 2.1 time: 0.180130 Jun 27 18:49:01.177660 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 240/477] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:00 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1369 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:01.195795 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-5c4d6fff-af44-4972-8a2d-14e5c38b2828 req-68589197-dc2a-44e8-92c1-50e085210a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ea7c5b-dbe4-4239-970b-62001a2c0d95", "name": "network-vif-deleted", "tag": "a19f9366-a373-4d5a-bc15-91acd3bd6281"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:49:01.204777 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-5c4d6fff-af44-4972-8a2d-14e5c38b2828 req-68589197-dc2a-44e8-92c1-50e085210a12 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:01.205241 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-5c4d6fff-af44-4972-8a2d-14e5c38b2828 req-68589197-dc2a-44e8-92c1-50e085210a12 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:01.216890 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-5c4d6fff-af44-4972-8a2d-14e5c38b2828 req-68589197-dc2a-44e8-92c1-50e085210a12 service nova] Creating event network-vif-deleted:a19f9366-a373-4d5a-bc15-91acd3bd6281 for instance c8ea7c5b-dbe4-4239-970b-62001a2c0d95 on hv-cinder-84460 Jun 27 18:49:01.222683 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-5c4d6fff-af44-4972-8a2d-14e5c38b2828 req-68589197-dc2a-44e8-92c1-50e085210a12 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032178 Jun 27 18:49:01.224004 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 238/478] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:49:01.441340 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-5131c09a-ad51-40c6-8062-12e350a52720 req-cea7d6ba-8736-49ae-a4d7-a5333d088277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c18b111d-f2de-41ac-8ae4-6738845259fb", "name": "network-vif-plugged", "status": "completed", "tag": "e7f919f9-9aa0-4ce8-a9d5-eaf1aec06292"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:49:01.450612 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-5131c09a-ad51-40c6-8062-12e350a52720 req-cea7d6ba-8736-49ae-a4d7-a5333d088277 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:01.451089 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-5131c09a-ad51-40c6-8062-12e350a52720 req-cea7d6ba-8736-49ae-a4d7-a5333d088277 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:01.461968 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-5131c09a-ad51-40c6-8062-12e350a52720 req-cea7d6ba-8736-49ae-a4d7-a5333d088277 service nova] Creating event network-vif-plugged:e7f919f9-9aa0-4ce8-a9d5-eaf1aec06292 for instance c18b111d-f2de-41ac-8ae4-6738845259fb on hv-cinder-84460 Jun 27 18:49:01.468017 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-5131c09a-ad51-40c6-8062-12e350a52720 req-cea7d6ba-8736-49ae-a4d7-a5333d088277 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030429 Jun 27 18:49:01.468623 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 241/479] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:49:01.575715 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e0ae4cbc-c7a2-417e-be84-58bdbad80a8f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:01.577087 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e0ae4cbc-c7a2-417e-be84-58bdbad80a8f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:01.584977 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e0ae4cbc-c7a2-417e-be84-58bdbad80a8f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:01.585540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e0ae4cbc-c7a2-417e-be84-58bdbad80a8f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:01.586433 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e0ae4cbc-c7a2-417e-be84-58bdbad80a8f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:01.586945 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e0ae4cbc-c7a2-417e-be84-58bdbad80a8f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:01.727319 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-e0ae4cbc-c7a2-417e-be84-58bdbad80a8f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:01.742966 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e0ae4cbc-c7a2-417e-be84-58bdbad80a8f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1676 microversion: 2.1 time: 0.172209 Jun 27 18:49:01.743558 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 239/480] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:01 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:01.864464 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-bb8cc195-779a-4c9e-b2b0-0d80666c6401 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:01.865218 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-bb8cc195-779a-4c9e-b2b0-0d80666c6401 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:01.872077 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bb8cc195-779a-4c9e-b2b0-0d80666c6401 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:01.872538 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bb8cc195-779a-4c9e-b2b0-0d80666c6401 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:01.873331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bb8cc195-779a-4c9e-b2b0-0d80666c6401 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:01.873766 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bb8cc195-779a-4c9e-b2b0-0d80666c6401 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:01.883987 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e1deba6d-2795-48d8-976e-fd0966ef15e3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:01.884622 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e1deba6d-2795-48d8-976e-fd0966ef15e3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:01.891710 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e1deba6d-2795-48d8-976e-fd0966ef15e3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:01.892159 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e1deba6d-2795-48d8-976e-fd0966ef15e3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:01.892912 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e1deba6d-2795-48d8-976e-fd0966ef15e3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:01.893343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e1deba6d-2795-48d8-976e-fd0966ef15e3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:01.927455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e1deba6d-2795-48d8-976e-fd0966ef15e3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:01.927913 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e1deba6d-2795-48d8-976e-fd0966ef15e3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:01.928504 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.objects.instance [None req-e1deba6d-2795-48d8-976e-fd0966ef15e3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lazy-loading 'fault' on Instance uuid c8ea7c5b-dbe4-4239-970b-62001a2c0d95 {{(pid=124717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:49:01.940426 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-bb8cc195-779a-4c9e-b2b0-0d80666c6401 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:01.948075 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-bb8cc195-779a-4c9e-b2b0-0d80666c6401 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1139 microversion: 2.1 time: 0.087804 Jun 27 18:49:01.949576 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 242/481] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:01 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1139 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:01.973048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-e1deba6d-2795-48d8-976e-fd0966ef15e3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c1ad9da81f48c390ad82e10e44712d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7a3d93a3a84224b7b23d93924f276f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:01.975465 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:49:01.981696 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e1deba6d-2795-48d8-976e-fd0966ef15e3 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 200 len: 1304 microversion: 2.1 time: 0.101501 Jun 27 18:49:01.982275 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 240/482] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:01 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:02.047586 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-ba4f6f60-816b-46db-83e3-b574a556ddbb tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:02.048246 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-ba4f6f60-816b-46db-83e3-b574a556ddbb tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:02.054662 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ba4f6f60-816b-46db-83e3-b574a556ddbb tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:02.055218 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ba4f6f60-816b-46db-83e3-b574a556ddbb tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:02.056073 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ba4f6f60-816b-46db-83e3-b574a556ddbb tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:02.056617 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ba4f6f60-816b-46db-83e3-b574a556ddbb tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:02.082755 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-ba4f6f60-816b-46db-83e3-b574a556ddbb tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Going to try to terminate instance {{(pid=124716) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 18:49:02.185341 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e20bc943-af0a-4983-b754-dc043c999088 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:02.186061 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e20bc943-af0a-4983-b754-dc043c999088 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:02.192556 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e20bc943-af0a-4983-b754-dc043c999088 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:02.193007 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e20bc943-af0a-4983-b754-dc043c999088 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:02.193777 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e20bc943-af0a-4983-b754-dc043c999088 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:02.194216 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e20bc943-af0a-4983-b754-dc043c999088 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:02.327483 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-e20bc943-af0a-4983-b754-dc043c999088 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:02.337277 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e20bc943-af0a-4983-b754-dc043c999088 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1369 microversion: 2.1 time: 0.155730 Jun 27 18:49:02.337862 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 241/483] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:02 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1369 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:49:02.480655 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-ba4f6f60-816b-46db-83e3-b574a556ddbb tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831" status: 204 len: 0 microversion: 2.1 time: 0.436566 Jun 27 18:49:02.481482 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 243/484] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:49:02 2022] DELETE /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 18:49:02.489883 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-acd4ff98-1fa0-439e-afa0-d5adb508e724 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:02.490528 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-acd4ff98-1fa0-439e-afa0-d5adb508e724 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:02.497160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-acd4ff98-1fa0-439e-afa0-d5adb508e724 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:02.497607 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-acd4ff98-1fa0-439e-afa0-d5adb508e724 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:02.498360 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-acd4ff98-1fa0-439e-afa0-d5adb508e724 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:02.498816 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-acd4ff98-1fa0-439e-afa0-d5adb508e724 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:02.631182 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-acd4ff98-1fa0-439e-afa0-d5adb508e724 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:02.639038 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-acd4ff98-1fa0-439e-afa0-d5adb508e724 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831" status: 200 len: 1513 microversion: 2.1 time: 0.153371 Jun 27 18:49:02.639607 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 242/485] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:02 2022] GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:02.760721 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-83796d53-2150-4f9d-a742-f8a856ea194d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:02.761493 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-83796d53-2150-4f9d-a742-f8a856ea194d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:02.767591 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-83796d53-2150-4f9d-a742-f8a856ea194d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:02.768039 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-83796d53-2150-4f9d-a742-f8a856ea194d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:02.768791 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-83796d53-2150-4f9d-a742-f8a856ea194d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:02.769226 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-83796d53-2150-4f9d-a742-f8a856ea194d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:02.895968 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-83796d53-2150-4f9d-a742-f8a856ea194d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:02.903465 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-83796d53-2150-4f9d-a742-f8a856ea194d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1676 microversion: 2.1 time: 0.147040 Jun 27 18:49:02.904031 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 244/486] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:02 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:02.966852 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-01ab51de-e119-4a04-b021-6473e7f9832e tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:02.967507 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-01ab51de-e119-4a04-b021-6473e7f9832e tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:02.973506 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-01ab51de-e119-4a04-b021-6473e7f9832e tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:02.973956 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-01ab51de-e119-4a04-b021-6473e7f9832e tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:02.974750 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-01ab51de-e119-4a04-b021-6473e7f9832e tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:02.975191 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-01ab51de-e119-4a04-b021-6473e7f9832e tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:02.998892 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-d54500f3-dde5-49f5-b45f-f658757dd4e5 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:02.999591 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-d54500f3-dde5-49f5-b45f-f658757dd4e5 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] [instance: c8ea7c5b-dbe4-4239-970b-62001a2c0d95] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:03.005878 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d54500f3-dde5-49f5-b45f-f658757dd4e5 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:03.006318 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d54500f3-dde5-49f5-b45f-f658757dd4e5 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:03.007112 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d54500f3-dde5-49f5-b45f-f658757dd4e5 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:03.007544 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d54500f3-dde5-49f5-b45f-f658757dd4e5 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:03.021478 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-d54500f3-dde5-49f5-b45f-f658757dd4e5 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] HTTP exception thrown: Instance c8ea7c5b-dbe4-4239-970b-62001a2c0d95 could not be found. Jun 27 18:49:03.023152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-d54500f3-dde5-49f5-b45f-f658757dd4e5 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Request method failure captured: Jun 27 18:49:03.023152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 HTTP/1.1 Jun 27 18:49:03.023152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:49:03.023152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:49:03.023152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:49:03.023152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:49:03.023152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:49:03.023152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:49:03.023152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:49:03.023152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:49:03.023152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiuftmuXFFAdgSGuSbB1xabJR61xd_5m6-fcGxMPlFAl1WC7UddiBlGLuZJY683sstUH6KaDaokwqgLz7L219q-mED7lB8l3PXY3nVLQ1YyuGQNGf5VEC8-mIzkr-4fXqU-0OIQmoml1LX7X159rj66rhO6KBGk3zZGMXJ6y_d2i1jIyc Jun 27 18:49:03.023152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:49:03.023152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:49:03.023152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:49:03.023152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:49:03.023152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:49:03.023152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:49:03.023152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: bc7a3d93a3a84224b7b23d93924f276f Jun 27 18:49:03.023152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-VolumesActionsTest-1014368731 Jun 27 18:49:03.023152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:49:03.023152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:49:03.024645 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bc7a3d93a3a84224b7b23d93924f276f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bc7a3d93a3a84224b7b23d93924f276f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bc7a3d93a3a84224b7b23d93924f276f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bc7a3d93a3a84224b7b23d93924f276f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:49:03.024645 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-VolumesActionsTest-1014368731 Jun 27 18:49:03.024645 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: bc7a3d93a3a84224b7b23d93924f276f Jun 27 18:49:03.024645 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-VolumesActionsTest-1014368731 Jun 27 18:49:03.024645 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-VolumesActionsTest-1014368731-project Jun 27 18:49:03.024645 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:49:03.024645 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:49:03.024645 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: d3c1ad9da81f48c390ad82e10e44712d Jun 27 18:49:03.024645 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-VolumesActionsTest-1014368731-project Jun 27 18:49:03.024645 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: > Jun 27 18:49:03.024645 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Instance c8ea7c5b-dbe4-4239-970b-62001a2c0d95 could not be found. Jun 27 18:49:03.024645 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': 'c8ea7c5b-dbe4-4239-970b-62001a2c0d95'} Jun 27 18:49:03.025441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:49:03.025441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:49:03.025441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:49:03.025441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:49:03.025441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:49:03.025441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:49:03.025441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:49:03.025441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:49:03.025441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:49:03.025441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:49:03.025441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ea7c5b-dbe4-4239-970b-62001a2c0d95 could not be found. Jun 27 18:49:03.025441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:49:03.025441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:49:03.025441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:49:03.025441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:49:03.025441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:49:03.025441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:49:03.025441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:49:03.025441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:49:03.025441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:49:03.027572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:49:03.027572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:49:03.027572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:49:03.027572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:49:03.027572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:49:03.027572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:49:03.027572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:49:03.027572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ea7c5b-dbe4-4239-970b-62001a2c0d95 could not be found. Jun 27 18:49:03.027572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:49:03.027572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:49:03.027572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:49:03.027572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:49:03.027572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:49:03.027572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:49:03.027572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:49:03.027572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:49:03.027572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ea7c5b-dbe4-4239-970b-62001a2c0d95 could not be found. Jun 27 18:49:03.027572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:49:03.029286 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-d54500f3-dde5-49f5-b45f-f658757dd4e5 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] Returning 404 to user: Instance c8ea7c5b-dbe4-4239-970b-62001a2c0d95 could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:49:03.029286 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-d54500f3-dde5-49f5-b45f-f658757dd4e5 tempest-VolumesActionsTest-1014368731 tempest-VolumesActionsTest-1014368731-project] 10.222.0.15 "GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95" status: 404 len: 111 microversion: 2.1 time: 0.029607 Jun 27 18:49:03.029286 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 245/487] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:02 2022] GET /compute/v2.1/servers/c8ea7c5b-dbe4-4239-970b-62001a2c0d95 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 18:49:03.037783 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-01ab51de-e119-4a04-b021-6473e7f9832e tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:03.046665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-01ab51de-e119-4a04-b021-6473e7f9832e tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1187 microversion: 2.1 time: 0.084738 Jun 27 18:49:03.047231 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 243/488] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:02 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:03.355379 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-e2e92fae-7367-418f-be63-4df9c2f59350 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:03.356409 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-e2e92fae-7367-418f-be63-4df9c2f59350 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:03.362727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e2e92fae-7367-418f-be63-4df9c2f59350 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:03.363181 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e2e92fae-7367-418f-be63-4df9c2f59350 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:03.364026 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e2e92fae-7367-418f-be63-4df9c2f59350 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:03.364465 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e2e92fae-7367-418f-be63-4df9c2f59350 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:03.502732 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-e2e92fae-7367-418f-be63-4df9c2f59350 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:03.510505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-e2e92fae-7367-418f-be63-4df9c2f59350 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1369 microversion: 2.1 time: 0.159538 Jun 27 18:49:03.511081 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 246/489] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:03 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:03.656975 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-462fb7c6-8a01-459a-8cd8-ce0889dd29e9 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:03.657711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-462fb7c6-8a01-459a-8cd8-ce0889dd29e9 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:03.664140 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-462fb7c6-8a01-459a-8cd8-ce0889dd29e9 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:03.664647 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-462fb7c6-8a01-459a-8cd8-ce0889dd29e9 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:03.665410 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-462fb7c6-8a01-459a-8cd8-ce0889dd29e9 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:03.670905 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-462fb7c6-8a01-459a-8cd8-ce0889dd29e9 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:03.799284 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-462fb7c6-8a01-459a-8cd8-ce0889dd29e9 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:03.806812 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-462fb7c6-8a01-459a-8cd8-ce0889dd29e9 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831" status: 200 len: 1513 microversion: 2.1 time: 0.155108 Jun 27 18:49:03.807384 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 244/490] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:03 2022] GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:03.920728 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-979836dd-7908-432b-835e-cec94e242f93 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:03.921353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-979836dd-7908-432b-835e-cec94e242f93 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:03.927812 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-979836dd-7908-432b-835e-cec94e242f93 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:03.928410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-979836dd-7908-432b-835e-cec94e242f93 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:03.929187 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-979836dd-7908-432b-835e-cec94e242f93 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:03.929624 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-979836dd-7908-432b-835e-cec94e242f93 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:04.063248 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-979836dd-7908-432b-835e-cec94e242f93 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:04.065709 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-48a0a2c1-1ec7-43e3-a717-8ffbb486bdfe tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:04.065709 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-48a0a2c1-1ec7-43e3-a717-8ffbb486bdfe tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:04.070838 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-979836dd-7908-432b-835e-cec94e242f93 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1676 microversion: 2.1 time: 0.154067 Jun 27 18:49:04.071289 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-48a0a2c1-1ec7-43e3-a717-8ffbb486bdfe tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:04.071806 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 247/491] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:03 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:04.071953 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-48a0a2c1-1ec7-43e3-a717-8ffbb486bdfe tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:04.072626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-48a0a2c1-1ec7-43e3-a717-8ffbb486bdfe tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:04.073070 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-48a0a2c1-1ec7-43e3-a717-8ffbb486bdfe tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:04.137618 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-48a0a2c1-1ec7-43e3-a717-8ffbb486bdfe tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:04.145375 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-48a0a2c1-1ec7-43e3-a717-8ffbb486bdfe tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1187 microversion: 2.1 time: 0.085059 Jun 27 18:49:04.146073 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 245/492] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:04 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:49:04.527930 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a7a197b4-7a1b-4f65-b047-090cdb9d9a0b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:04.528577 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a7a197b4-7a1b-4f65-b047-090cdb9d9a0b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:04.534938 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a7a197b4-7a1b-4f65-b047-090cdb9d9a0b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:04.535390 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a7a197b4-7a1b-4f65-b047-090cdb9d9a0b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:04.536149 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a7a197b4-7a1b-4f65-b047-090cdb9d9a0b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:04.536583 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a7a197b4-7a1b-4f65-b047-090cdb9d9a0b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:04.662749 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a7a197b4-7a1b-4f65-b047-090cdb9d9a0b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:04.670010 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a7a197b4-7a1b-4f65-b047-090cdb9d9a0b tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1369 microversion: 2.1 time: 0.146038 Jun 27 18:49:04.671175 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 248/493] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:04 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1369 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:04.824666 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-25913271-9e06-4148-b7b0-82fc30413c55 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:04.825286 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-25913271-9e06-4148-b7b0-82fc30413c55 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:04.832149 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-25913271-9e06-4148-b7b0-82fc30413c55 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:04.832603 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-25913271-9e06-4148-b7b0-82fc30413c55 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:04.833366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-25913271-9e06-4148-b7b0-82fc30413c55 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:04.833808 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-25913271-9e06-4148-b7b0-82fc30413c55 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:04.959013 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-25913271-9e06-4148-b7b0-82fc30413c55 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:04.966363 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-25913271-9e06-4148-b7b0-82fc30413c55 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831" status: 200 len: 1513 microversion: 2.1 time: 0.145617 Jun 27 18:49:04.966952 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 246/494] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:04 2022] GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831 => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:05.088896 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-be7bcd7e-8d42-4667-8450-38277c4ec63f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:05.089558 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-be7bcd7e-8d42-4667-8450-38277c4ec63f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:05.096275 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-be7bcd7e-8d42-4667-8450-38277c4ec63f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:05.096725 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-be7bcd7e-8d42-4667-8450-38277c4ec63f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:05.097482 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-be7bcd7e-8d42-4667-8450-38277c4ec63f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:05.097920 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-be7bcd7e-8d42-4667-8450-38277c4ec63f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:05.161780 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-ce12f8f4-18a9-48a6-8092-3a73062a0ace tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:05.162411 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-ce12f8f4-18a9-48a6-8092-3a73062a0ace tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:05.168776 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ce12f8f4-18a9-48a6-8092-3a73062a0ace tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:05.169221 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ce12f8f4-18a9-48a6-8092-3a73062a0ace tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:05.169983 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ce12f8f4-18a9-48a6-8092-3a73062a0ace tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:05.171259 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ce12f8f4-18a9-48a6-8092-3a73062a0ace tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:05.243061 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-ce12f8f4-18a9-48a6-8092-3a73062a0ace tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:05.250478 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-ce12f8f4-18a9-48a6-8092-3a73062a0ace tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1187 microversion: 2.1 time: 0.092523 Jun 27 18:49:05.251049 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 247/495] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:05 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:49:05.259573 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-be7bcd7e-8d42-4667-8450-38277c4ec63f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:05.267429 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-be7bcd7e-8d42-4667-8450-38277c4ec63f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1676 microversion: 2.1 time: 0.182367 Jun 27 18:49:05.267999 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 249/496] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:05 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:05.688270 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0f441ec1-13c7-4678-b957-55b564132e85 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:05.688886 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-0f441ec1-13c7-4678-b957-55b564132e85 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:05.694808 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0f441ec1-13c7-4678-b957-55b564132e85 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:05.695291 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0f441ec1-13c7-4678-b957-55b564132e85 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:05.696046 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0f441ec1-13c7-4678-b957-55b564132e85 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:05.696477 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0f441ec1-13c7-4678-b957-55b564132e85 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:05.824797 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-0f441ec1-13c7-4678-b957-55b564132e85 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:05.833104 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-0f441ec1-13c7-4678-b957-55b564132e85 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1369 microversion: 2.1 time: 0.149865 Jun 27 18:49:05.833667 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 248/497] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:05 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:05.984197 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-58d47978-8e64-4bc4-ad14-e3403c507e36 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:05.984811 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-58d47978-8e64-4bc4-ad14-e3403c507e36 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:05.990745 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-58d47978-8e64-4bc4-ad14-e3403c507e36 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:05.991197 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-58d47978-8e64-4bc4-ad14-e3403c507e36 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:05.991946 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-58d47978-8e64-4bc4-ad14-e3403c507e36 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:05.992377 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-58d47978-8e64-4bc4-ad14-e3403c507e36 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:06.122235 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-58d47978-8e64-4bc4-ad14-e3403c507e36 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:06.130606 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-58d47978-8e64-4bc4-ad14-e3403c507e36 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831" status: 200 len: 1513 microversion: 2.1 time: 0.151034 Jun 27 18:49:06.131168 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 250/498] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:05 2022] GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:06.268424 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-99c15e2d-3afc-47aa-9f60-ffad408c6dc5 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:06.268963 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-99c15e2d-3afc-47aa-9f60-ffad408c6dc5 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:06.275131 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-99c15e2d-3afc-47aa-9f60-ffad408c6dc5 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:06.275575 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-99c15e2d-3afc-47aa-9f60-ffad408c6dc5 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:06.276329 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-99c15e2d-3afc-47aa-9f60-ffad408c6dc5 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:06.276757 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-99c15e2d-3afc-47aa-9f60-ffad408c6dc5 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:06.284380 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-007ff234-1ec2-4213-ac88-8d480f770330 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:06.285031 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-007ff234-1ec2-4213-ac88-8d480f770330 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:06.291011 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-007ff234-1ec2-4213-ac88-8d480f770330 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:06.291461 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-007ff234-1ec2-4213-ac88-8d480f770330 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:06.292226 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-007ff234-1ec2-4213-ac88-8d480f770330 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:06.292667 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-007ff234-1ec2-4213-ac88-8d480f770330 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:06.340424 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-99c15e2d-3afc-47aa-9f60-ffad408c6dc5 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:06.348400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-99c15e2d-3afc-47aa-9f60-ffad408c6dc5 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1187 microversion: 2.1 time: 0.084963 Jun 27 18:49:06.348986 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 249/499] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:06 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:06.439645 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-007ff234-1ec2-4213-ac88-8d480f770330 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:06.447023 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-007ff234-1ec2-4213-ac88-8d480f770330 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1676 microversion: 2.1 time: 0.166448 Jun 27 18:49:06.447585 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 251/500] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:06 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:06.849440 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-2e6a7c60-c849-4075-8dc7-32dbe2b2101c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:06.850051 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-2e6a7c60-c849-4075-8dc7-32dbe2b2101c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:06.856736 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2e6a7c60-c849-4075-8dc7-32dbe2b2101c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:06.857207 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2e6a7c60-c849-4075-8dc7-32dbe2b2101c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:06.858672 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2e6a7c60-c849-4075-8dc7-32dbe2b2101c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:06.859418 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2e6a7c60-c849-4075-8dc7-32dbe2b2101c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:07.148125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-211941ed-a597-401b-96b5-a2a03696f727 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:07.148748 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-211941ed-a597-401b-96b5-a2a03696f727 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:07.155918 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-211941ed-a597-401b-96b5-a2a03696f727 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:07.156374 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-211941ed-a597-401b-96b5-a2a03696f727 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:07.157144 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-211941ed-a597-401b-96b5-a2a03696f727 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:07.157586 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-211941ed-a597-401b-96b5-a2a03696f727 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:07.195535 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-2e6a7c60-c849-4075-8dc7-32dbe2b2101c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:07.203733 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-2e6a7c60-c849-4075-8dc7-32dbe2b2101c tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1369 microversion: 2.1 time: 0.358101 Jun 27 18:49:07.204321 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 250/501] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:06 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1369 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:07.289367 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-211941ed-a597-401b-96b5-a2a03696f727 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:07.297068 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-211941ed-a597-401b-96b5-a2a03696f727 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831" status: 200 len: 1513 microversion: 2.1 time: 0.152799 Jun 27 18:49:07.297633 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 252/502] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:07 2022] GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:49:07.366299 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e7fcc7ce-82db-4aae-a5e0-0e4f27ad03a1 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:07.366950 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e7fcc7ce-82db-4aae-a5e0-0e4f27ad03a1 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:07.372934 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e7fcc7ce-82db-4aae-a5e0-0e4f27ad03a1 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:07.373380 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e7fcc7ce-82db-4aae-a5e0-0e4f27ad03a1 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:07.374890 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e7fcc7ce-82db-4aae-a5e0-0e4f27ad03a1 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:07.375327 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e7fcc7ce-82db-4aae-a5e0-0e4f27ad03a1 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:07.442039 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-e7fcc7ce-82db-4aae-a5e0-0e4f27ad03a1 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:07.449483 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e7fcc7ce-82db-4aae-a5e0-0e4f27ad03a1 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1187 microversion: 2.1 time: 0.087175 Jun 27 18:49:07.450047 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 251/503] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:07 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:07.464839 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-0a25d2cb-256a-4161-83f9-615861515a75 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:07.465449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-0a25d2cb-256a-4161-83f9-615861515a75 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:07.471777 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0a25d2cb-256a-4161-83f9-615861515a75 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:07.473592 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0a25d2cb-256a-4161-83f9-615861515a75 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:07.473592 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0a25d2cb-256a-4161-83f9-615861515a75 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:07.473592 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0a25d2cb-256a-4161-83f9-615861515a75 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:07.603549 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-0a25d2cb-256a-4161-83f9-615861515a75 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:07.611605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-0a25d2cb-256a-4161-83f9-615861515a75 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1676 microversion: 2.1 time: 0.150595 Jun 27 18:49:07.612175 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 253/504] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:07 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:07.724334 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e47390f3-68e7-4fa6-951f-aab75de9a694 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:07.724765 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e47390f3-68e7-4fa6-951f-aab75de9a694 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:07.730859 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e47390f3-68e7-4fa6-951f-aab75de9a694 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:07.731563 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e47390f3-68e7-4fa6-951f-aab75de9a694 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:07.732326 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e47390f3-68e7-4fa6-951f-aab75de9a694 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:07.732763 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e47390f3-68e7-4fa6-951f-aab75de9a694 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:07.765351 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e47390f3-68e7-4fa6-951f-aab75de9a694 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f/os-volume_attachments/9f2417cc-55de-41b5-9732-a5426c2e1066" status: 200 len: 194 microversion: 2.20 time: 0.045091 Jun 27 18:49:07.765934 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 252/505] 10.222.0.15 () {60 vars in 1453 bytes} [Mon Jun 27 18:49:07 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f/os-volume_attachments/9f2417cc-55de-41b5-9732-a5426c2e1066 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 18:49:07.828741 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f798b000-bb80-4fa4-9736-21685c759be9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:07.829239 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f798b000-bb80-4fa4-9736-21685c759be9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:07.835271 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f798b000-bb80-4fa4-9736-21685c759be9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:07.835720 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f798b000-bb80-4fa4-9736-21685c759be9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:07.836481 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f798b000-bb80-4fa4-9736-21685c759be9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:07.836917 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f798b000-bb80-4fa4-9736-21685c759be9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:07.916059 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.objects.instance [None req-f798b000-bb80-4fa4-9736-21685c759be9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lazy-loading 'services' on Instance uuid 91366512-6fa4-4a20-a867-94852749b02f {{(pid=124716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:49:08.073841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f798b000-bb80-4fa4-9736-21685c759be9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "DELETE /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f/os-volume_attachments/9f2417cc-55de-41b5-9732-a5426c2e1066" status: 202 len: 0 microversion: 2.20 time: 0.249494 Jun 27 18:49:08.074653 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 254/506] 10.222.0.15 () {60 vars in 1456 bytes} [Mon Jun 27 18:49:07 2022] DELETE /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f/os-volume_attachments/9f2417cc-55de-41b5-9732-a5426c2e1066 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 18:49:08.083624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-1d1278d1-4f7b-4dbe-8da5-359ba37d0fa8 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:08.084699 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-1d1278d1-4f7b-4dbe-8da5-359ba37d0fa8 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:08.091493 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1d1278d1-4f7b-4dbe-8da5-359ba37d0fa8 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:08.091950 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1d1278d1-4f7b-4dbe-8da5-359ba37d0fa8 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:08.093319 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1d1278d1-4f7b-4dbe-8da5-359ba37d0fa8 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:08.093754 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1d1278d1-4f7b-4dbe-8da5-359ba37d0fa8 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:08.125860 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-1d1278d1-4f7b-4dbe-8da5-359ba37d0fa8 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046234 Jun 27 18:49:08.126699 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 253/507] 10.222.0.15 () {60 vars in 1342 bytes} [Mon Jun 27 18:49:08 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 18:49:08.221745 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-ce611da1-a58f-48d4-8baf-c9304d4b7a5f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:08.222597 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-ce611da1-a58f-48d4-8baf-c9304d4b7a5f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:08.229808 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ce611da1-a58f-48d4-8baf-c9304d4b7a5f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:08.230273 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ce611da1-a58f-48d4-8baf-c9304d4b7a5f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:08.231571 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ce611da1-a58f-48d4-8baf-c9304d4b7a5f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:08.232022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ce611da1-a58f-48d4-8baf-c9304d4b7a5f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:08.236429 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:49:08.314337 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-c691b6ef-3eb5-4b06-b46a-7eff58a8c7e6 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:08.315076 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-c691b6ef-3eb5-4b06-b46a-7eff58a8c7e6 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:08.321356 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c691b6ef-3eb5-4b06-b46a-7eff58a8c7e6 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:08.321821 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c691b6ef-3eb5-4b06-b46a-7eff58a8c7e6 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:08.322632 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c691b6ef-3eb5-4b06-b46a-7eff58a8c7e6 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:08.323137 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c691b6ef-3eb5-4b06-b46a-7eff58a8c7e6 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:08.406786 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-ce611da1-a58f-48d4-8baf-c9304d4b7a5f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:08.418730 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-ce611da1-a58f-48d4-8baf-c9304d4b7a5f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1562 microversion: 2.1 time: 0.201793 Jun 27 18:49:08.429261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 255/508] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:08 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1562 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:49:08.439568 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-ba74e3bf-c7a3-46bb-926c-8e8cb0235e87 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:08.440067 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-ba74e3bf-c7a3-46bb-926c-8e8cb0235e87 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:08.446682 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ba74e3bf-c7a3-46bb-926c-8e8cb0235e87 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:08.447408 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ba74e3bf-c7a3-46bb-926c-8e8cb0235e87 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:08.448201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ba74e3bf-c7a3-46bb-926c-8e8cb0235e87 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:08.448629 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ba74e3bf-c7a3-46bb-926c-8e8cb0235e87 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:08.483074 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-c691b6ef-3eb5-4b06-b46a-7eff58a8c7e6 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:08.491027 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-c691b6ef-3eb5-4b06-b46a-7eff58a8c7e6 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831" status: 200 len: 1513 microversion: 2.1 time: 0.181196 Jun 27 18:49:08.491705 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 254/509] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:08 2022] GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831 => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:49:08.508389 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-70058566-5406-4090-becd-0c75bc6ceec4 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:08.509576 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-70058566-5406-4090-becd-0c75bc6ceec4 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:08.518661 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-70058566-5406-4090-becd-0c75bc6ceec4 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:08.519272 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-70058566-5406-4090-becd-0c75bc6ceec4 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:08.520472 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-70058566-5406-4090-becd-0c75bc6ceec4 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:08.521076 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-70058566-5406-4090-becd-0c75bc6ceec4 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:08.542168 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-ba74e3bf-c7a3-46bb-926c-8e8cb0235e87 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106616 Jun 27 18:49:08.543776 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 256/510] 10.222.0.15 () {58 vars in 1274 bytes} [Mon Jun 27 18:49:08 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:49:08.635198 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-70058566-5406-4090-becd-0c75bc6ceec4 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:08.647013 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-ab4a0bf3-f0c5-4cf5-ba5e-0745d806b95c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:08.647995 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-ab4a0bf3-f0c5-4cf5-ba5e-0745d806b95c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:08.661174 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-70058566-5406-4090-becd-0c75bc6ceec4 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1195 microversion: 2.1 time: 0.165998 Jun 27 18:49:08.672270 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 255/511] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:08 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1195 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:08.675684 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ab4a0bf3-f0c5-4cf5-ba5e-0745d806b95c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:08.676250 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ab4a0bf3-f0c5-4cf5-ba5e-0745d806b95c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:08.677166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ab4a0bf3-f0c5-4cf5-ba5e-0745d806b95c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:08.677691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ab4a0bf3-f0c5-4cf5-ba5e-0745d806b95c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:08.713895 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-4f33d1ba-9642-4840-8b25-51e3b4bef304 req-0008c2da-9344-4d23-8180-36f2de81ee63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab81efbc-7e62-4405-a45a-5d8448895831", "name": "network-vif-deleted", "tag": "9e4f60d5-1a7d-41b7-903c-ffe073243353"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:49:08.727652 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-4f33d1ba-9642-4840-8b25-51e3b4bef304 req-0008c2da-9344-4d23-8180-36f2de81ee63 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:08.728826 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-4f33d1ba-9642-4840-8b25-51e3b4bef304 req-0008c2da-9344-4d23-8180-36f2de81ee63 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:08.761360 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-4f33d1ba-9642-4840-8b25-51e3b4bef304 req-0008c2da-9344-4d23-8180-36f2de81ee63 service nova] Creating event network-vif-deleted:9e4f60d5-1a7d-41b7-903c-ffe073243353 for instance ab81efbc-7e62-4405-a45a-5d8448895831 on hv-cinder-84460 Jun 27 18:49:08.767229 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-4f33d1ba-9642-4840-8b25-51e3b4bef304 req-0008c2da-9344-4d23-8180-36f2de81ee63 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058619 Jun 27 18:49:08.768123 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 256/512] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:49:09.036255 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-ab4a0bf3-f0c5-4cf5-ba5e-0745d806b95c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:09.045117 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-ab4a0bf3-f0c5-4cf5-ba5e-0745d806b95c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1676 microversion: 2.1 time: 0.419460 Jun 27 18:49:09.046416 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 257/513] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:08 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1676 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:49:09.140242 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e7f26921-e8ca-44dd-8898-c59acb433606 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:09.141291 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e7f26921-e8ca-44dd-8898-c59acb433606 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:09.152331 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e7f26921-e8ca-44dd-8898-c59acb433606 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:09.152828 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e7f26921-e8ca-44dd-8898-c59acb433606 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:09.153636 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e7f26921-e8ca-44dd-8898-c59acb433606 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:09.154299 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e7f26921-e8ca-44dd-8898-c59acb433606 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:09.194892 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e7f26921-e8ca-44dd-8898-c59acb433606 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060659 Jun 27 18:49:09.200580 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 257/514] 10.222.0.15 () {60 vars in 1342 bytes} [Mon Jun 27 18:49:09 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 18:49:09.510779 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-c07c3eae-fc29-4d17-b316-a545bed7e08c tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:09.511570 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-c07c3eae-fc29-4d17-b316-a545bed7e08c tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:09.520832 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c07c3eae-fc29-4d17-b316-a545bed7e08c tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:09.522205 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c07c3eae-fc29-4d17-b316-a545bed7e08c tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:09.523242 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c07c3eae-fc29-4d17-b316-a545bed7e08c tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:09.523835 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c07c3eae-fc29-4d17-b316-a545bed7e08c tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:09.568226 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c07c3eae-fc29-4d17-b316-a545bed7e08c tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:09.568700 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c07c3eae-fc29-4d17-b316-a545bed7e08c tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:09.569152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.objects.instance [None req-c07c3eae-fc29-4d17-b316-a545bed7e08c tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lazy-loading 'fault' on Instance uuid ab81efbc-7e62-4405-a45a-5d8448895831 {{(pid=124716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:49:09.619043 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c07c3eae-fc29-4d17-b316-a545bed7e08c tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:09.628942 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-c07c3eae-fc29-4d17-b316-a545bed7e08c tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831" status: 200 len: 1308 microversion: 2.1 time: 0.123718 Jun 27 18:49:09.638834 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 258/515] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:09 2022] GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831 => generated 1308 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:09.680811 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-28efb3bb-dc8e-47c7-b38c-03b3f70741bf tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:09.681617 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-28efb3bb-dc8e-47c7-b38c-03b3f70741bf tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:09.696542 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-28efb3bb-dc8e-47c7-b38c-03b3f70741bf tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:09.697186 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-28efb3bb-dc8e-47c7-b38c-03b3f70741bf tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:09.703017 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-28efb3bb-dc8e-47c7-b38c-03b3f70741bf tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:09.703745 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-28efb3bb-dc8e-47c7-b38c-03b3f70741bf tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:09.707029 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=100 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:49:09.814167 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-28efb3bb-dc8e-47c7-b38c-03b3f70741bf tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:09.824751 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-28efb3bb-dc8e-47c7-b38c-03b3f70741bf tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1205 microversion: 2.1 time: 0.148540 Jun 27 18:49:09.826917 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 258/516] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:09 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1205 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:10.063038 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-31cc5e9f-bd3e-458c-a653-8657fed43773 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:10.064009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-31cc5e9f-bd3e-458c-a653-8657fed43773 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:10.076181 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-31cc5e9f-bd3e-458c-a653-8657fed43773 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:10.077036 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-31cc5e9f-bd3e-458c-a653-8657fed43773 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:10.077985 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-31cc5e9f-bd3e-458c-a653-8657fed43773 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:10.078606 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-31cc5e9f-bd3e-458c-a653-8657fed43773 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:10.208628 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-905f1437-50c6-4d41-ba88-70aeedb1e3e8 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:10.209350 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-905f1437-50c6-4d41-ba88-70aeedb1e3e8 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:10.216182 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-905f1437-50c6-4d41-ba88-70aeedb1e3e8 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:10.216638 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-905f1437-50c6-4d41-ba88-70aeedb1e3e8 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:10.217519 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-905f1437-50c6-4d41-ba88-70aeedb1e3e8 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:10.218044 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-905f1437-50c6-4d41-ba88-70aeedb1e3e8 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:10.253524 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-905f1437-50c6-4d41-ba88-70aeedb1e3e8 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049456 Jun 27 18:49:10.254733 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 259/517] 10.222.0.15 () {60 vars in 1342 bytes} [Mon Jun 27 18:49:10 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:49:10.266418 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=2 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:49:10.352246 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a62b752f-32db-4e06-b6b3-fbc978fd50f1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:10.353100 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-a62b752f-32db-4e06-b6b3-fbc978fd50f1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:10.360217 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a62b752f-32db-4e06-b6b3-fbc978fd50f1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:10.360909 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a62b752f-32db-4e06-b6b3-fbc978fd50f1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:10.361859 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a62b752f-32db-4e06-b6b3-fbc978fd50f1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:10.362477 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a62b752f-32db-4e06-b6b3-fbc978fd50f1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:10.390169 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-a62b752f-32db-4e06-b6b3-fbc978fd50f1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Going to try to terminate instance {{(pid=124717) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 18:49:10.523582 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-31cc5e9f-bd3e-458c-a653-8657fed43773 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:10.537186 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-31cc5e9f-bd3e-458c-a653-8657fed43773 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1676 microversion: 2.1 time: 0.478609 Jun 27 18:49:10.547666 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 259/518] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:10 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1676 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:10.647546 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f7f569d3-600f-4f58-a4a4-4e18c7939e79 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:10.648320 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f7f569d3-600f-4f58-a4a4-4e18c7939e79 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: ab81efbc-7e62-4405-a45a-5d8448895831] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:10.666020 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f7f569d3-600f-4f58-a4a4-4e18c7939e79 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:10.666623 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f7f569d3-600f-4f58-a4a4-4e18c7939e79 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:10.667560 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f7f569d3-600f-4f58-a4a4-4e18c7939e79 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:10.667986 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f7f569d3-600f-4f58-a4a4-4e18c7939e79 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:10.720760 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-f7f569d3-600f-4f58-a4a4-4e18c7939e79 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] HTTP exception thrown: Instance ab81efbc-7e62-4405-a45a-5d8448895831 could not be found. Jun 27 18:49:10.723885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f7f569d3-600f-4f58-a4a4-4e18c7939e79 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Request method failure captured: Jun 27 18:49:10.723885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831 HTTP/1.1 Jun 27 18:49:10.723885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:49:10.723885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:49:10.723885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:49:10.723885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:49:10.723885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:49:10.723885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:49:10.723885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:49:10.723885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:49:10.723885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiuftUjWWxrg_Yq1pNEgv2Q0Sc6AHn93XN1rfll7IfeTJqkzXCgN4C0ehKZhuv3KJVTcxnAris1MZVFcgpzBC_hZ1TkczV6dIgL5OvRqg6cCrUd3drd4GDaNtAmh0IIPfDTmL6ScN8c1r-G4iWQdqyyTAm1NZ_eW_9Fdbh5r1YNgGhD-Y Jun 27 18:49:10.723885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:49:10.723885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:49:10.723885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:49:10.723885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:49:10.723885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:49:10.723885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:49:10.723885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: 5284ec5970e14418bfbd5391ee3b282c Jun 27 18:49:10.723885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1292741423 Jun 27 18:49:10.723885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:49:10.723885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:49:10.725442 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5284ec5970e14418bfbd5391ee3b282c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5284ec5970e14418bfbd5391ee3b282c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5284ec5970e14418bfbd5391ee3b282c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5284ec5970e14418bfbd5391ee3b282c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:49:10.725442 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-VolumesSnapshotTestJSON-1292741423 Jun 27 18:49:10.725442 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: 5284ec5970e14418bfbd5391ee3b282c Jun 27 18:49:10.725442 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1292741423 Jun 27 18:49:10.725442 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-VolumesSnapshotTestJSON-1292741423-project Jun 27 18:49:10.725442 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:49:10.725442 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:49:10.725442 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: f5f17909688f40f9b752e63b4074c2ee Jun 27 18:49:10.725442 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-VolumesSnapshotTestJSON-1292741423-project Jun 27 18:49:10.725442 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: > Jun 27 18:49:10.725442 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Instance ab81efbc-7e62-4405-a45a-5d8448895831 could not be found. Jun 27 18:49:10.725442 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': 'ab81efbc-7e62-4405-a45a-5d8448895831'} Jun 27 18:49:10.726332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:49:10.726332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:49:10.726332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:49:10.726332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:49:10.726332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:49:10.726332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:49:10.726332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:49:10.726332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:49:10.726332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:49:10.726332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:49:10.726332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab81efbc-7e62-4405-a45a-5d8448895831 could not be found. Jun 27 18:49:10.726332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:49:10.726332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:49:10.726332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:49:10.726332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:49:10.726332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:49:10.726332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:49:10.726332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:49:10.726332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:49:10.726332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:49:10.728327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:49:10.728327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:49:10.728327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:49:10.728327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:49:10.728327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:49:10.728327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:49:10.728327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:49:10.728327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab81efbc-7e62-4405-a45a-5d8448895831 could not be found. Jun 27 18:49:10.728327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:49:10.728327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:49:10.728327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:49:10.728327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:49:10.728327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:49:10.728327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:49:10.728327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:49:10.728327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:49:10.728327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab81efbc-7e62-4405-a45a-5d8448895831 could not be found. Jun 27 18:49:10.728327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:49:10.732832 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f7f569d3-600f-4f58-a4a4-4e18c7939e79 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Returning 404 to user: Instance ab81efbc-7e62-4405-a45a-5d8448895831 could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:49:10.751404 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f7f569d3-600f-4f58-a4a4-4e18c7939e79 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831" status: 404 len: 111 microversion: 2.1 time: 0.108938 Jun 27 18:49:10.753537 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 260/519] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:10 2022] GET /compute/v2.1/servers/ab81efbc-7e62-4405-a45a-5d8448895831 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:49:10.812884 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-a62b752f-32db-4e06-b6b3-fbc978fd50f1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "DELETE /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 204 len: 0 microversion: 2.20 time: 0.464201 Jun 27 18:49:10.814110 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 260/520] 10.222.0.15 () {60 vars in 1279 bytes} [Mon Jun 27 18:49:10 2022] DELETE /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 27 18:49:10.824728 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f7b985a2-ebd5-47e9-80ab-de2da41a59ec tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:10.825759 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f7b985a2-ebd5-47e9-80ab-de2da41a59ec tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:10.845239 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=8 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:49:10.847104 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-bf0c9560-c607-4852-920d-d1571a1f42b6 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:10.848080 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-bf0c9560-c607-4852-920d-d1571a1f42b6 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:10.853747 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f7b985a2-ebd5-47e9-80ab-de2da41a59ec tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:10.855962 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f7b985a2-ebd5-47e9-80ab-de2da41a59ec tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:10.857052 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f7b985a2-ebd5-47e9-80ab-de2da41a59ec tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:10.860327 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bf0c9560-c607-4852-920d-d1571a1f42b6 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:10.861555 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bf0c9560-c607-4852-920d-d1571a1f42b6 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:10.861789 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f7b985a2-ebd5-47e9-80ab-de2da41a59ec tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:10.863707 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bf0c9560-c607-4852-920d-d1571a1f42b6 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:10.865148 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bf0c9560-c607-4852-920d-d1571a1f42b6 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:11.472326 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f7b985a2-ebd5-47e9-80ab-de2da41a59ec tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:11.487411 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-bf0c9560-c607-4852-920d-d1571a1f42b6 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:11.488024 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f7b985a2-ebd5-47e9-80ab-de2da41a59ec tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:11.489182 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f7b985a2-ebd5-47e9-80ab-de2da41a59ec tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:11.490976 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f7b985a2-ebd5-47e9-80ab-de2da41a59ec tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1723 microversion: 2.20 time: 0.671824 Jun 27 18:49:11.492707 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 261/521] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:49:10 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1723 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:49:11.496856 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-bf0c9560-c607-4852-920d-d1571a1f42b6 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1273 microversion: 2.1 time: 0.654428 Jun 27 18:49:11.498046 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 261/522] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:10 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1273 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:49:11.511280 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-cd2809b1-ab33-458f-94f6-384832902686 req-08c787e4-2392-4c8a-8cd3-57a6a973de68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c18b111d-f2de-41ac-8ae4-6738845259fb", "tag": "e7f919f9-9aa0-4ce8-a9d5-eaf1aec06292"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:49:11.536392 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-cd2809b1-ab33-458f-94f6-384832902686 req-08c787e4-2392-4c8a-8cd3-57a6a973de68 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:11.539431 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-cd2809b1-ab33-458f-94f6-384832902686 req-08c787e4-2392-4c8a-8cd3-57a6a973de68 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:11.555933 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-487623c3-9a12-422d-a7cb-e4f9db8414c3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:11.559884 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-487623c3-9a12-422d-a7cb-e4f9db8414c3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:11.560138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-cd2809b1-ab33-458f-94f6-384832902686 req-08c787e4-2392-4c8a-8cd3-57a6a973de68 service nova] Creating event network-changed:e7f919f9-9aa0-4ce8-a9d5-eaf1aec06292 for instance c18b111d-f2de-41ac-8ae4-6738845259fb on hv-cinder-84460 Jun 27 18:49:11.564428 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-cd2809b1-ab33-458f-94f6-384832902686 req-08c787e4-2392-4c8a-8cd3-57a6a973de68 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070038 Jun 27 18:49:11.565107 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 262/523] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:49:11.566587 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-487623c3-9a12-422d-a7cb-e4f9db8414c3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:11.567049 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-487623c3-9a12-422d-a7cb-e4f9db8414c3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:11.568058 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-487623c3-9a12-422d-a7cb-e4f9db8414c3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:11.568426 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-487623c3-9a12-422d-a7cb-e4f9db8414c3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:11.747487 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-487623c3-9a12-422d-a7cb-e4f9db8414c3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:11.757806 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-487623c3-9a12-422d-a7cb-e4f9db8414c3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1676 microversion: 2.1 time: 0.206282 Jun 27 18:49:11.758858 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 262/524] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:11 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1676 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:49:12.524734 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-273955c7-b262-4bac-8369-b7e087cd43f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:12.525520 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-273955c7-b262-4bac-8369-b7e087cd43f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:12.533016 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-3fe32741-ffd8-4e89-9142-de74131cca34 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:12.533663 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-3fe32741-ffd8-4e89-9142-de74131cca34 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:12.541598 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3fe32741-ffd8-4e89-9142-de74131cca34 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:12.541920 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-273955c7-b262-4bac-8369-b7e087cd43f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:12.542367 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3fe32741-ffd8-4e89-9142-de74131cca34 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:12.542589 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-273955c7-b262-4bac-8369-b7e087cd43f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:12.543168 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3fe32741-ffd8-4e89-9142-de74131cca34 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:12.543665 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-273955c7-b262-4bac-8369-b7e087cd43f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:12.543780 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3fe32741-ffd8-4e89-9142-de74131cca34 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:12.544273 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-273955c7-b262-4bac-8369-b7e087cd43f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:12.755142 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-273955c7-b262-4bac-8369-b7e087cd43f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:12.758463 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-3fe32741-ffd8-4e89-9142-de74131cca34 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:12.767192 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-3fe32741-ffd8-4e89-9142-de74131cca34 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1273 microversion: 2.1 time: 0.239598 Jun 27 18:49:12.767779 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 263/525] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:12 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1273 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:12.771767 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-273955c7-b262-4bac-8369-b7e087cd43f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:12.773274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-273955c7-b262-4bac-8369-b7e087cd43f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:12.774488 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-273955c7-b262-4bac-8369-b7e087cd43f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1723 microversion: 2.20 time: 0.255727 Jun 27 18:49:12.775036 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 263/526] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:49:12 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:49:12.800023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-91b4e247-ed8d-4a50-bdb3-e616fd41e0e0 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:12.800644 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-91b4e247-ed8d-4a50-bdb3-e616fd41e0e0 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:12.806748 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-91b4e247-ed8d-4a50-bdb3-e616fd41e0e0 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:12.807198 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-91b4e247-ed8d-4a50-bdb3-e616fd41e0e0 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:12.807953 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-91b4e247-ed8d-4a50-bdb3-e616fd41e0e0 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:12.808385 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-91b4e247-ed8d-4a50-bdb3-e616fd41e0e0 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:12.948133 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-91b4e247-ed8d-4a50-bdb3-e616fd41e0e0 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:12.956045 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-91b4e247-ed8d-4a50-bdb3-e616fd41e0e0 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1676 microversion: 2.1 time: 0.168419 Jun 27 18:49:12.956610 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 264/527] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:12 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:13.784879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-130c3693-026f-493c-a9f8-76311d459d30 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:13.785493 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-130c3693-026f-493c-a9f8-76311d459d30 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:13.791947 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-130c3693-026f-493c-a9f8-76311d459d30 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:13.792393 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-130c3693-026f-493c-a9f8-76311d459d30 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:13.793143 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-130c3693-026f-493c-a9f8-76311d459d30 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:13.793573 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-130c3693-026f-493c-a9f8-76311d459d30 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:13.797407 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-ed2914d1-267e-4b5c-8e3d-65f82b1e1cd7 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:13.798022 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-ed2914d1-267e-4b5c-8e3d-65f82b1e1cd7 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:13.804180 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ed2914d1-267e-4b5c-8e3d-65f82b1e1cd7 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:13.804631 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ed2914d1-267e-4b5c-8e3d-65f82b1e1cd7 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:13.805396 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ed2914d1-267e-4b5c-8e3d-65f82b1e1cd7 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:13.805831 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ed2914d1-267e-4b5c-8e3d-65f82b1e1cd7 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:13.990694 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-130c3693-026f-493c-a9f8-76311d459d30 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:13.998103 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-ed2914d1-267e-4b5c-8e3d-65f82b1e1cd7 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:13.998478 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-130c3693-026f-493c-a9f8-76311d459d30 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1273 microversion: 2.1 time: 0.217412 Jun 27 18:49:13.999674 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 264/528] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:13 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1273 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:14.004210 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-0fa6d5a1-fed4-4e72-be5c-6e1b9a7c4914 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:14.010861 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-0fa6d5a1-fed4-4e72-be5c-6e1b9a7c4914 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:14.010987 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-ed2914d1-267e-4b5c-8e3d-65f82b1e1cd7 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:14.011152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0fa6d5a1-fed4-4e72-be5c-6e1b9a7c4914 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:14.011307 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-ed2914d1-267e-4b5c-8e3d-65f82b1e1cd7 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:14.011415 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0fa6d5a1-fed4-4e72-be5c-6e1b9a7c4914 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:14.011685 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0fa6d5a1-fed4-4e72-be5c-6e1b9a7c4914 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:14.012116 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0fa6d5a1-fed4-4e72-be5c-6e1b9a7c4914 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:14.012254 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-ed2914d1-267e-4b5c-8e3d-65f82b1e1cd7 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1723 microversion: 2.20 time: 0.219194 Jun 27 18:49:14.012821 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 265/529] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:49:13 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:49:14.138567 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-0fa6d5a1-fed4-4e72-be5c-6e1b9a7c4914 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:14.145930 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-0fa6d5a1-fed4-4e72-be5c-6e1b9a7c4914 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1676 microversion: 2.1 time: 0.145283 Jun 27 18:49:14.146512 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 265/530] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:13 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1676 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:15.017032 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-211cc186-ea1b-4dec-b5f3-565f05dd7c02 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:15.018268 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-211cc186-ea1b-4dec-b5f3-565f05dd7c02 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:15.032217 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-4d9659b1-2e80-4fa4-95d8-583cbc4c0298 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:15.033159 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-4d9659b1-2e80-4fa4-95d8-583cbc4c0298 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:15.033486 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-211cc186-ea1b-4dec-b5f3-565f05dd7c02 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:15.034130 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-211cc186-ea1b-4dec-b5f3-565f05dd7c02 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:15.036022 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-211cc186-ea1b-4dec-b5f3-565f05dd7c02 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:15.038582 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-211cc186-ea1b-4dec-b5f3-565f05dd7c02 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:15.049570 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4d9659b1-2e80-4fa4-95d8-583cbc4c0298 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:15.050488 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4d9659b1-2e80-4fa4-95d8-583cbc4c0298 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:15.052831 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4d9659b1-2e80-4fa4-95d8-583cbc4c0298 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:15.053547 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4d9659b1-2e80-4fa4-95d8-583cbc4c0298 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:15.493166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-4d9659b1-2e80-4fa4-95d8-583cbc4c0298 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:15.511181 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-211cc186-ea1b-4dec-b5f3-565f05dd7c02 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:15.524436 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-4d9659b1-2e80-4fa4-95d8-583cbc4c0298 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:15.528049 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-4d9659b1-2e80-4fa4-95d8-583cbc4c0298 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:15.529814 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-4d9659b1-2e80-4fa4-95d8-583cbc4c0298 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1723 microversion: 2.20 time: 0.502488 Jun 27 18:49:15.531863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 266/531] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:49:15 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1723 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:49:15.540693 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-5c94a96d-4178-4c3f-b09f-23525c9f6b63 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:15.541815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-5c94a96d-4178-4c3f-b09f-23525c9f6b63 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:15.558059 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5c94a96d-4178-4c3f-b09f-23525c9f6b63 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:15.558709 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5c94a96d-4178-4c3f-b09f-23525c9f6b63 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:15.559761 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5c94a96d-4178-4c3f-b09f-23525c9f6b63 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:15.560368 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5c94a96d-4178-4c3f-b09f-23525c9f6b63 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:15.589733 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-211cc186-ea1b-4dec-b5f3-565f05dd7c02 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1273 microversion: 2.1 time: 0.577290 Jun 27 18:49:15.590322 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 266/532] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:15 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1273 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:16.020022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-5c94a96d-4178-4c3f-b09f-23525c9f6b63 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:16.035358 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-5c94a96d-4178-4c3f-b09f-23525c9f6b63 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1676 microversion: 2.1 time: 0.502318 Jun 27 18:49:16.036108 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 267/533] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:15 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1676 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:16.415449 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-13de4fcb-40d4-40b8-9a74-fcac8794b973 req-97a0e313-f577-4f24-8892-5871c41daba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a731689-b26b-4f41-a3d3-4d1a2ebff239", "tag": "d446f8e5-97d8-434f-9b91-31d20061c950"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:49:16.434949 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-13de4fcb-40d4-40b8-9a74-fcac8794b973 req-97a0e313-f577-4f24-8892-5871c41daba8 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:16.438160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-13de4fcb-40d4-40b8-9a74-fcac8794b973 req-97a0e313-f577-4f24-8892-5871c41daba8 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:16.459467 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-13de4fcb-40d4-40b8-9a74-fcac8794b973 req-97a0e313-f577-4f24-8892-5871c41daba8 service nova] Creating event network-changed:d446f8e5-97d8-434f-9b91-31d20061c950 for instance 2a731689-b26b-4f41-a3d3-4d1a2ebff239 on hv-cinder-84460 Jun 27 18:49:16.471048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-13de4fcb-40d4-40b8-9a74-fcac8794b973 req-97a0e313-f577-4f24-8892-5871c41daba8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056936 Jun 27 18:49:16.471725 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 267/534] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:49:16.554994 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-23e053af-1fe1-4bb3-84f6-51fe849ab326 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:16.558872 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-23e053af-1fe1-4bb3-84f6-51fe849ab326 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:16.572489 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-23e053af-1fe1-4bb3-84f6-51fe849ab326 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:16.573665 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-23e053af-1fe1-4bb3-84f6-51fe849ab326 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:16.574850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-23e053af-1fe1-4bb3-84f6-51fe849ab326 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:16.575449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-23e053af-1fe1-4bb3-84f6-51fe849ab326 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:16.617090 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-274ff034-8865-448a-8d26-dddc1e98eb12 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:16.618663 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-274ff034-8865-448a-8d26-dddc1e98eb12 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:16.643725 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-274ff034-8865-448a-8d26-dddc1e98eb12 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:16.646444 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-274ff034-8865-448a-8d26-dddc1e98eb12 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:16.647732 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-274ff034-8865-448a-8d26-dddc1e98eb12 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:16.659505 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-274ff034-8865-448a-8d26-dddc1e98eb12 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:16.999871 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-274ff034-8865-448a-8d26-dddc1e98eb12 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:17.016160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-274ff034-8865-448a-8d26-dddc1e98eb12 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1261 microversion: 2.1 time: 0.411173 Jun 27 18:49:17.025812 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 268/535] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:16 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1261 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:49:17.052833 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-03fa288a-3a3b-4520-a012-f16d3c7a374c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:17.053907 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-03fa288a-3a3b-4520-a012-f16d3c7a374c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:17.072862 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-03fa288a-3a3b-4520-a012-f16d3c7a374c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:17.076201 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-03fa288a-3a3b-4520-a012-f16d3c7a374c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:17.080625 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-03fa288a-3a3b-4520-a012-f16d3c7a374c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:17.081093 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-03fa288a-3a3b-4520-a012-f16d3c7a374c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:17.274556 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-23e053af-1fe1-4bb3-84f6-51fe849ab326 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:17.291595 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-23e053af-1fe1-4bb3-84f6-51fe849ab326 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:17.302154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-23e053af-1fe1-4bb3-84f6-51fe849ab326 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:17.304600 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-23e053af-1fe1-4bb3-84f6-51fe849ab326 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1723 microversion: 2.20 time: 0.756063 Jun 27 18:49:17.319293 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 268/536] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:49:16 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1723 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:49:17.334296 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-03fa288a-3a3b-4520-a012-f16d3c7a374c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:17.344412 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-03fa288a-3a3b-4520-a012-f16d3c7a374c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1653 microversion: 2.1 time: 0.293576 Jun 27 18:49:17.356341 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 269/537] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:17 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1653 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:17.367576 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-4a72c2c9-c595-4c4e-99a7-f2f5176a752c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:49:17.377845 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4a72c2c9-c595-4c4e-99a7-f2f5176a752c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:17.378762 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4a72c2c9-c595-4c4e-99a7-f2f5176a752c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:17.419979 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-4a72c2c9-c595-4c4e-99a7-f2f5176a752c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Going to try to start instance {{(pid=124716) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 27 18:49:17.612461 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-285a0a6e-6c50-4639-aaf6-57a21d2b0a8d req-307600b1-84cc-428f-a74f-95811642cfad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91366512-6fa4-4a20-a867-94852749b02f", "name": "network-vif-deleted", "tag": "3ca020b2-805d-45e4-9147-1a3d32b54834"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:49:17.623566 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-285a0a6e-6c50-4639-aaf6-57a21d2b0a8d req-307600b1-84cc-428f-a74f-95811642cfad service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:17.624920 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-285a0a6e-6c50-4639-aaf6-57a21d2b0a8d req-307600b1-84cc-428f-a74f-95811642cfad service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:17.638670 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-4a72c2c9-c595-4c4e-99a7-f2f5176a752c tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "POST /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91/action" status: 202 len: 0 microversion: 2.1 time: 0.280695 Jun 27 18:49:17.643697 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 269/538] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Jun 27 18:49:17 2022] POST /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:49:17.643847 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-285a0a6e-6c50-4639-aaf6-57a21d2b0a8d req-307600b1-84cc-428f-a74f-95811642cfad service nova] Creating event network-vif-deleted:3ca020b2-805d-45e4-9147-1a3d32b54834 for instance 91366512-6fa4-4a20-a867-94852749b02f on hv-cinder-84460 Jun 27 18:49:17.647221 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-285a0a6e-6c50-4639-aaf6-57a21d2b0a8d req-307600b1-84cc-428f-a74f-95811642cfad service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040279 Jun 27 18:49:17.649856 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f9eba47c-7818-4961-9c5a-505d632fd21e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:17.652899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 270/539] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:49:17.665957 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f9eba47c-7818-4961-9c5a-505d632fd21e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:17.692725 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f9eba47c-7818-4961-9c5a-505d632fd21e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:17.699393 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f9eba47c-7818-4961-9c5a-505d632fd21e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:17.699393 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f9eba47c-7818-4961-9c5a-505d632fd21e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:17.699393 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f9eba47c-7818-4961-9c5a-505d632fd21e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:17.959321 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f9eba47c-7818-4961-9c5a-505d632fd21e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:17.972807 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f9eba47c-7818-4961-9c5a-505d632fd21e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1662 microversion: 2.1 time: 0.327019 Jun 27 18:49:17.973926 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 270/540] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:17 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1662 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:18.034987 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-4a8cf590-0918-47f2-9c81-541e5aaff01c tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:18.036006 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-4a8cf590-0918-47f2-9c81-541e5aaff01c tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:18.043556 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4a8cf590-0918-47f2-9c81-541e5aaff01c tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:18.044352 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4a8cf590-0918-47f2-9c81-541e5aaff01c tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:18.045531 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4a8cf590-0918-47f2-9c81-541e5aaff01c tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:18.046521 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4a8cf590-0918-47f2-9c81-541e5aaff01c tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:18.329909 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-0cb77468-fa38-4d93-827e-be4f4f8f5f5e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:18.331072 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-0cb77468-fa38-4d93-827e-be4f4f8f5f5e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:18.344184 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0cb77468-fa38-4d93-827e-be4f4f8f5f5e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:18.346763 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0cb77468-fa38-4d93-827e-be4f4f8f5f5e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:18.348082 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0cb77468-fa38-4d93-827e-be4f4f8f5f5e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:18.352380 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0cb77468-fa38-4d93-827e-be4f4f8f5f5e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:18.390898 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-4a8cf590-0918-47f2-9c81-541e5aaff01c tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:18.399853 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-4a8cf590-0918-47f2-9c81-541e5aaff01c tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1261 microversion: 2.1 time: 0.369414 Jun 27 18:49:18.401373 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 271/541] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:18 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1261 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:18.441367 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0cb77468-fa38-4d93-827e-be4f4f8f5f5e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:18.442248 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0cb77468-fa38-4d93-827e-be4f4f8f5f5e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:18.443579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.objects.instance [None req-0cb77468-fa38-4d93-827e-be4f4f8f5f5e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lazy-loading 'fault' on Instance uuid 91366512-6fa4-4a20-a867-94852749b02f {{(pid=124716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:49:18.507138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-0cb77468-fa38-4d93-827e-be4f4f8f5f5e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:18.509533 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:49:18.523633 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-0cb77468-fa38-4d93-827e-be4f4f8f5f5e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:18.530022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-0cb77468-fa38-4d93-827e-be4f4f8f5f5e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:18.530022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-0cb77468-fa38-4d93-827e-be4f4f8f5f5e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1371 microversion: 2.20 time: 0.201191 Jun 27 18:49:18.530022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 271/542] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:49:18 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:49:18.991298 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-aeaffec3-6c20-4508-befa-6e67d08f1560 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:18.991915 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-aeaffec3-6c20-4508-befa-6e67d08f1560 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:18.999485 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-aeaffec3-6c20-4508-befa-6e67d08f1560 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:19.000187 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-aeaffec3-6c20-4508-befa-6e67d08f1560 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:19.000994 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-aeaffec3-6c20-4508-befa-6e67d08f1560 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:19.001568 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-aeaffec3-6c20-4508-befa-6e67d08f1560 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:19.145248 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-aeaffec3-6c20-4508-befa-6e67d08f1560 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:19.158326 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-aeaffec3-6c20-4508-befa-6e67d08f1560 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1662 microversion: 2.1 time: 0.170809 Jun 27 18:49:19.159498 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 272/543] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:18 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1662 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:19.417661 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-bce91853-80f9-454a-911b-8a29032b905f tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:19.418396 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-bce91853-80f9-454a-911b-8a29032b905f tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:19.426400 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bce91853-80f9-454a-911b-8a29032b905f tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:19.427210 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bce91853-80f9-454a-911b-8a29032b905f tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:19.428233 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bce91853-80f9-454a-911b-8a29032b905f tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:19.428859 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bce91853-80f9-454a-911b-8a29032b905f tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:19.548857 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a2caf5b0-9265-4728-b28a-87cfb0dd655e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:19.549786 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-a2caf5b0-9265-4728-b28a-87cfb0dd655e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:19.560260 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:49:19.562128 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a2caf5b0-9265-4728-b28a-87cfb0dd655e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:19.563901 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a2caf5b0-9265-4728-b28a-87cfb0dd655e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:19.565228 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a2caf5b0-9265-4728-b28a-87cfb0dd655e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:19.566979 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a2caf5b0-9265-4728-b28a-87cfb0dd655e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:19.600315 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-bce91853-80f9-454a-911b-8a29032b905f tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:19.610035 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-bce91853-80f9-454a-911b-8a29032b905f tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1261 microversion: 2.1 time: 0.196635 Jun 27 18:49:19.619806 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 272/544] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:19 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1261 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:49:19.624325 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a2caf5b0-9265-4728-b28a-87cfb0dd655e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:19.624325 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a2caf5b0-9265-4728-b28a-87cfb0dd655e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:19.624325 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.objects.instance [None req-a2caf5b0-9265-4728-b28a-87cfb0dd655e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lazy-loading 'fault' on Instance uuid 91366512-6fa4-4a20-a867-94852749b02f {{(pid=124717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:49:19.677008 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a2caf5b0-9265-4728-b28a-87cfb0dd655e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:19.686417 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a2caf5b0-9265-4728-b28a-87cfb0dd655e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:19.688205 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a2caf5b0-9265-4728-b28a-87cfb0dd655e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:19.691505 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-a2caf5b0-9265-4728-b28a-87cfb0dd655e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1371 microversion: 2.20 time: 0.148164 Jun 27 18:49:19.702838 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 273/545] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:49:19 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:49:20.176445 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-1675e0af-be2a-4bcc-b2b0-b94f45c4281e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:20.177065 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-1675e0af-be2a-4bcc-b2b0-b94f45c4281e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:20.183867 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1675e0af-be2a-4bcc-b2b0-b94f45c4281e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:20.184548 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1675e0af-be2a-4bcc-b2b0-b94f45c4281e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:20.185606 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1675e0af-be2a-4bcc-b2b0-b94f45c4281e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:20.186199 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1675e0af-be2a-4bcc-b2b0-b94f45c4281e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:20.364001 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-1675e0af-be2a-4bcc-b2b0-b94f45c4281e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:20.372748 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-1675e0af-be2a-4bcc-b2b0-b94f45c4281e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1662 microversion: 2.1 time: 0.200705 Jun 27 18:49:20.373323 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 273/546] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:20 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1662 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:20.627642 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e69cfb6e-9417-4e61-883f-16e74fe1b547 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:20.628188 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e69cfb6e-9417-4e61-883f-16e74fe1b547 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:20.644057 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e69cfb6e-9417-4e61-883f-16e74fe1b547 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:20.644908 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e69cfb6e-9417-4e61-883f-16e74fe1b547 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:20.645946 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e69cfb6e-9417-4e61-883f-16e74fe1b547 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:20.646460 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e69cfb6e-9417-4e61-883f-16e74fe1b547 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:20.649363 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:49:20.709664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-6467088d-f34a-4b9e-9b2f-149480c6c40f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:20.710293 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-6467088d-f34a-4b9e-9b2f-149480c6c40f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:20.716213 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:49:20.717667 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6467088d-f34a-4b9e-9b2f-149480c6c40f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:20.718462 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6467088d-f34a-4b9e-9b2f-149480c6c40f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:20.719489 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6467088d-f34a-4b9e-9b2f-149480c6c40f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:20.720088 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6467088d-f34a-4b9e-9b2f-149480c6c40f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:20.768484 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6467088d-f34a-4b9e-9b2f-149480c6c40f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:20.769221 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6467088d-f34a-4b9e-9b2f-149480c6c40f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:20.769895 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.objects.instance [None req-6467088d-f34a-4b9e-9b2f-149480c6c40f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lazy-loading 'fault' on Instance uuid 91366512-6fa4-4a20-a867-94852749b02f {{(pid=124716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:49:20.855967 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-6467088d-f34a-4b9e-9b2f-149480c6c40f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:20.866374 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-6467088d-f34a-4b9e-9b2f-149480c6c40f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:20.867050 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-e69cfb6e-9417-4e61-883f-16e74fe1b547 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:20.870099 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-6467088d-f34a-4b9e-9b2f-149480c6c40f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:20.871770 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-6467088d-f34a-4b9e-9b2f-149480c6c40f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 200 len: 1371 microversion: 2.20 time: 0.166095 Jun 27 18:49:20.882850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 274/547] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:49:20 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:49:20.883129 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e69cfb6e-9417-4e61-883f-16e74fe1b547 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1261 microversion: 2.1 time: 0.252331 Jun 27 18:49:20.883129 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 274/548] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:20 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1261 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:21.394402 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-0aad5227-b04f-4733-a53c-bd1c09a65c94 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:21.395151 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-0aad5227-b04f-4733-a53c-bd1c09a65c94 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:21.401743 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0aad5227-b04f-4733-a53c-bd1c09a65c94 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:21.402191 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0aad5227-b04f-4733-a53c-bd1c09a65c94 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:21.403050 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0aad5227-b04f-4733-a53c-bd1c09a65c94 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:21.403490 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0aad5227-b04f-4733-a53c-bd1c09a65c94 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:21.767130 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-0aad5227-b04f-4733-a53c-bd1c09a65c94 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:21.780946 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-0aad5227-b04f-4733-a53c-bd1c09a65c94 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1662 microversion: 2.1 time: 0.389329 Jun 27 18:49:21.780946 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 275/549] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:21 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1662 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:21.891430 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-5787e95b-c42f-4c8e-8915-465644bd1529 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:21.892055 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-5787e95b-c42f-4c8e-8915-465644bd1529 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:21.893608 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-d2fbef67-0494-46d4-be1c-d9bc6c38272b tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:21.894603 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-d2fbef67-0494-46d4-be1c-d9bc6c38272b tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:21.903084 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d2fbef67-0494-46d4-be1c-d9bc6c38272b tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:21.903748 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d2fbef67-0494-46d4-be1c-d9bc6c38272b tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:21.904538 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d2fbef67-0494-46d4-be1c-d9bc6c38272b tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:21.905065 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d2fbef67-0494-46d4-be1c-d9bc6c38272b tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:21.908568 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5787e95b-c42f-4c8e-8915-465644bd1529 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:21.909353 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5787e95b-c42f-4c8e-8915-465644bd1529 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:21.910253 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5787e95b-c42f-4c8e-8915-465644bd1529 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:21.910979 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5787e95b-c42f-4c8e-8915-465644bd1529 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:21.926455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-5787e95b-c42f-4c8e-8915-465644bd1529 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] HTTP exception thrown: Instance 91366512-6fa4-4a20-a867-94852749b02f could not be found. Jun 27 18:49:21.928784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-5787e95b-c42f-4c8e-8915-465644bd1529 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Request method failure captured: Jun 27 18:49:21.928784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f HTTP/1.1 Jun 27 18:49:21.928784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 18:49:21.928784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 18:49:21.928784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 18:49:21.928784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 0 Jun 27 18:49:21.928784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 18:49:21.928784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 18:49:21.928784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 18:49:21.928784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 18:49:21.928784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufq_bpO0xE70bhp754i-ELyUiZpKCPBFqJlVJkEt-tcFB0NMYIR4AZGYNyJl81fEc_KQPzkNS1DYv7NGJBl5GQOXg1XLsM_rJL1zADgrZKZ7F5mORnC28fyA1LFbFTAv5ffwm2xW6YP1uSdtWWwxQXETpdKhC4Qec1EPagatsQXDf6E Jun 27 18:49:21.928784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 18:49:21.928784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 18:49:21.928784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 18:49:21.928784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 18:49:21.928784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 18:49:21.928784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 18:49:21.928784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 18:49:21.928784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: 80ec901270bc4375b22fba22ed2ff68c Jun 27 18:49:21.928784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-734361258 Jun 27 18:49:21.928784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 18:49:21.928784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 18:49:21.930233 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/80ec901270bc4375b22fba22ed2ff68c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/80ec901270bc4375b22fba22ed2ff68c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_80ec901270bc4375b22fba22ed2ff68c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/80ec901270bc4375b22fba22ed2ff68c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:49:21.930233 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-AttachVolumeShelveTestJSON-734361258 Jun 27 18:49:21.930233 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: 80ec901270bc4375b22fba22ed2ff68c Jun 27 18:49:21.930233 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-734361258 Jun 27 18:49:21.930233 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-AttachVolumeShelveTestJSON-734361258-project Jun 27 18:49:21.930233 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 18:49:21.930233 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 18:49:21.930233 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: f6d74ace9f674f0da40cb35f39d559c9 Jun 27 18:49:21.930233 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-AttachVolumeShelveTestJSON-734361258-project Jun 27 18:49:21.930233 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: > Jun 27 18:49:21.930233 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Instance 91366512-6fa4-4a20-a867-94852749b02f could not be found. Jun 27 18:49:21.930233 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'id': '91366512-6fa4-4a20-a867-94852749b02f'} Jun 27 18:49:21.931030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:49:21.931030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:49:21.931030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:49:21.931030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:49:21.931030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:49:21.931030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:49:21.931030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:49:21.931030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:49:21.931030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:49:21.931030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:49:21.931030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91366512-6fa4-4a20-a867-94852749b02f could not be found. Jun 27 18:49:21.931030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:49:21.931030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:49:21.931030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:49:21.931030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:49:21.931030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:49:21.931030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:49:21.931030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:49:21.931030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:49:21.931030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:49:21.932340 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:49:21.932340 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:49:21.932340 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:49:21.932340 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:49:21.932340 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:49:21.932340 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:49:21.932340 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:49:21.932340 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91366512-6fa4-4a20-a867-94852749b02f could not be found. Jun 27 18:49:21.932340 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:49:21.932340 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:49:21.932340 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:49:21.932340 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:49:21.932340 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:49:21.932340 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:49:21.932340 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:49:21.932340 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:49:21.932340 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91366512-6fa4-4a20-a867-94852749b02f could not be found. Jun 27 18:49:21.932340 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:49:21.933427 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-5787e95b-c42f-4c8e-8915-465644bd1529 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Returning 404 to user: Instance 91366512-6fa4-4a20-a867-94852749b02f could not be found. {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:49:21.933427 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-5787e95b-c42f-4c8e-8915-465644bd1529 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 404 len: 111 microversion: 2.20 time: 0.043363 Jun 27 18:49:21.934680 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 275/550] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:49:21 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 18:49:21.939584 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-5ef4cceb-8177-4d84-8b79-4ddcd231dfd6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '.version_select at 0x7f700ffedaf0>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:22.078213 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-d2fbef67-0494-46d4-be1c-d9bc6c38272b tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:22.085582 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-d2fbef67-0494-46d4-be1c-d9bc6c38272b tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1261 microversion: 2.1 time: 0.198217 Jun 27 18:49:22.086142 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 276/551] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:21 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1261 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:22.118657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-414f79f1-467d-4f42-953e-b3874e8ada89 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-858151474", "imageRef": "c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3", "flavorRef": "452", "networks": [{"uuid": "2f27c706-4564-442e-9b2f-a29bbaaf6698"}]}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:49:22.176032 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.network.neutron [None req-414f79f1-467d-4f42-953e-b3874e8ada89 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] validate_networks() for [('2f27c706-4564-442e-9b2f-a29bbaaf6698', None, None, None, None, None)] {{(pid=124716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 18:49:22.220495 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-5ef4cceb-8177-4d84-8b79-4ddcd231dfd6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1517937183" status: 204 len: 0 microversion: 2.20 time: 0.284756 Jun 27 18:49:22.222619 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 276/552] 10.222.0.15 () {60 vars in 1261 bytes} [Mon Jun 27 18:49:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1517937183 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 27 18:49:22.614043 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-414f79f1-467d-4f42-953e-b3874e8ada89 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Flavor limits 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 18:49:22.614553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-414f79f1-467d-4f42-953e-b3874e8ada89 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Image limits 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 18:49:22.615122 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-414f79f1-467d-4f42-953e-b3874e8ada89 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Flavor pref 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 18:49:22.615870 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-414f79f1-467d-4f42-953e-b3874e8ada89 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Image pref 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 18:49:22.616190 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-414f79f1-467d-4f42-953e-b3874e8ada89 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 18:49:22.645176 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-414f79f1-467d-4f42-953e-b3874e8ada89 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:22.646246 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-414f79f1-467d-4f42-953e-b3874e8ada89 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:22.648816 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-414f79f1-467d-4f42-953e-b3874e8ada89 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:22.649936 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-414f79f1-467d-4f42-953e-b3874e8ada89 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:22.682092 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-414f79f1-467d-4f42-953e-b3874e8ada89 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Getting quotas for project 5284ec5970e14418bfbd5391ee3b282c. Resources: {'ram', 'cores', 'instances'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:49:22.689168 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-414f79f1-467d-4f42-953e-b3874e8ada89 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Getting quotas for user f5f17909688f40f9b752e63b4074c2ee and project 5284ec5970e14418bfbd5391ee3b282c. Resources: {'ram', 'cores', 'instances'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:49:22.703405 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-414f79f1-467d-4f42-953e-b3874e8ada89 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Going to run 1 instances... {{(pid=124716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 18:49:22.707293 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-414f79f1-467d-4f42-953e-b3874e8ada89 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: 59583dbe-f7e7-4143-8192-b51ce91c7739] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 18:49:22.799146 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-9b35c90e-8c3d-431f-b134-55a3ecb18971 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:22.799875 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-9b35c90e-8c3d-431f-b134-55a3ecb18971 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:22.808777 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9b35c90e-8c3d-431f-b134-55a3ecb18971 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:22.812267 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9b35c90e-8c3d-431f-b134-55a3ecb18971 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:22.815792 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9b35c90e-8c3d-431f-b134-55a3ecb18971 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:22.817917 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9b35c90e-8c3d-431f-b134-55a3ecb18971 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:22.904161 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-414f79f1-467d-4f42-953e-b3874e8ada89 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789216 Jun 27 18:49:22.911598 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 277/553] 10.222.0.15 () {60 vars in 1146 bytes} [Mon Jun 27 18:49:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 18:49:22.929527 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-500691cb-df53-4806-8cd8-86016f48a941 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:22.930225 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-500691cb-df53-4806-8cd8-86016f48a941 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: 59583dbe-f7e7-4143-8192-b51ce91c7739] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:23.064777 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-500691cb-df53-4806-8cd8-86016f48a941 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:23.075005 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-500691cb-df53-4806-8cd8-86016f48a941 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739" status: 200 len: 1218 microversion: 2.1 time: 0.162260 Jun 27 18:49:23.085444 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 278/554] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:22 2022] GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739 => generated 1218 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:23.103915 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-4b5fdbd9-89d6-473d-ab85-eacb44184225 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:23.104851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-4b5fdbd9-89d6-473d-ab85-eacb44184225 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:23.132184 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4b5fdbd9-89d6-473d-ab85-eacb44184225 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:23.144009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4b5fdbd9-89d6-473d-ab85-eacb44184225 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:23.147816 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4b5fdbd9-89d6-473d-ab85-eacb44184225 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:23.149622 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4b5fdbd9-89d6-473d-ab85-eacb44184225 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:23.187781 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-9b35c90e-8c3d-431f-b134-55a3ecb18971 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:23.214440 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-9b35c90e-8c3d-431f-b134-55a3ecb18971 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1662 microversion: 2.1 time: 0.419793 Jun 27 18:49:23.223515 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 277/555] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:22 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1662 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:49:23.228889 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-afbd1b2d-2839-4e88-acf6-43dd5a0a3e08 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Action: 'create', calling method: .version_select at 0x7f700ff5a0d0>, body: {"keypair": {"name": "tempest-keypair-112762027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2dpEHdmldzzMjdGGMHC166+LRFM/IAMedOA7pJ+wRI4oiLSBI/0vhabaNdwg6nOfOitUIhSDfsLH8Gckf/9Hyq5NBz+4Ro3RkZ+Ddbxe/fFjsf/mDNfRgkVR1FG5jUPQ=="}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:49:23.251065 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-afbd1b2d-2839-4e88-acf6-43dd5a0a3e08 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Getting quotas for project 80ec901270bc4375b22fba22ed2ff68c. Resources: {'key_pairs'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:49:23.256433 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-afbd1b2d-2839-4e88-acf6-43dd5a0a3e08 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Getting quotas for user f6d74ace9f674f0da40cb35f39d559c9 and project 80ec901270bc4375b22fba22ed2ff68c. Resources: {'key_pairs'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:49:23.333290 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-afbd1b2d-2839-4e88-acf6-43dd5a0a3e08 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.108517 Jun 27 18:49:23.334619 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 278/556] 10.222.0.15 () {62 vars in 1199 bytes} [Mon Jun 27 18:49:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 111 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 27 18:49:23.649200 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-4b5fdbd9-89d6-473d-ab85-eacb44184225 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:23.674207 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-4b5fdbd9-89d6-473d-ab85-eacb44184225 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1261 microversion: 2.1 time: 0.574414 Jun 27 18:49:23.674855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 279/557] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:23 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1261 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:24.093288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-be7c1aef-0400-4f8b-837d-4bb34b9d2aad tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:24.095711 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-be7c1aef-0400-4f8b-837d-4bb34b9d2aad tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: 59583dbe-f7e7-4143-8192-b51ce91c7739] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:24.102733 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-be7c1aef-0400-4f8b-837d-4bb34b9d2aad tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:24.103953 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-be7c1aef-0400-4f8b-837d-4bb34b9d2aad tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:24.104483 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-be7c1aef-0400-4f8b-837d-4bb34b9d2aad tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:24.105412 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-be7c1aef-0400-4f8b-837d-4bb34b9d2aad tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:24.172705 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-be7c1aef-0400-4f8b-837d-4bb34b9d2aad tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:24.180324 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-be7c1aef-0400-4f8b-837d-4bb34b9d2aad tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739" status: 200 len: 1222 microversion: 2.1 time: 0.091431 Jun 27 18:49:24.190340 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 279/558] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:24 2022] GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739 => generated 1222 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:24.240471 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-8543a9f5-f2e8-4ded-ac55-24b1e985a1fb tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:24.241125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-8543a9f5-f2e8-4ded-ac55-24b1e985a1fb tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:24.248593 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8543a9f5-f2e8-4ded-ac55-24b1e985a1fb tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:24.249083 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8543a9f5-f2e8-4ded-ac55-24b1e985a1fb tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:24.249879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8543a9f5-f2e8-4ded-ac55-24b1e985a1fb tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:24.250533 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8543a9f5-f2e8-4ded-ac55-24b1e985a1fb tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:24.452782 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-8543a9f5-f2e8-4ded-ac55-24b1e985a1fb tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:24.469733 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-8543a9f5-f2e8-4ded-ac55-24b1e985a1fb tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1666 microversion: 2.1 time: 0.233214 Jun 27 18:49:24.470376 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 280/559] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:24 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1666 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:24.692544 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-93aff4a5-9181-4ab9-8ddb-8ef7aa1dd217 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:24.693187 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-93aff4a5-9181-4ab9-8ddb-8ef7aa1dd217 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:24.701160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-93aff4a5-9181-4ab9-8ddb-8ef7aa1dd217 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:24.702010 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-93aff4a5-9181-4ab9-8ddb-8ef7aa1dd217 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:24.703942 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-93aff4a5-9181-4ab9-8ddb-8ef7aa1dd217 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:24.704654 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-93aff4a5-9181-4ab9-8ddb-8ef7aa1dd217 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:24.887061 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-93aff4a5-9181-4ab9-8ddb-8ef7aa1dd217 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:24.895278 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-93aff4a5-9181-4ab9-8ddb-8ef7aa1dd217 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1261 microversion: 2.1 time: 0.206892 Jun 27 18:49:24.896913 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 280/560] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:24 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1261 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:25.199442 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-1a924813-8c0a-465a-aa47-b0aae530f594 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:25.201208 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-1a924813-8c0a-465a-aa47-b0aae530f594 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: 59583dbe-f7e7-4143-8192-b51ce91c7739] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:25.210179 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1a924813-8c0a-465a-aa47-b0aae530f594 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:25.210923 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1a924813-8c0a-465a-aa47-b0aae530f594 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:25.211917 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1a924813-8c0a-465a-aa47-b0aae530f594 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:25.212715 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1a924813-8c0a-465a-aa47-b0aae530f594 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:25.300359 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-1a924813-8c0a-465a-aa47-b0aae530f594 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:25.313438 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-1a924813-8c0a-465a-aa47-b0aae530f594 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739" status: 200 len: 1278 microversion: 2.1 time: 0.118557 Jun 27 18:49:25.324342 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 281/561] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:25 2022] GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739 => generated 1278 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:25.913770 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-c710a260-3556-43cf-a781-6c8c1201fc59 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:25.915223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-c710a260-3556-43cf-a781-6c8c1201fc59 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:25.925791 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c710a260-3556-43cf-a781-6c8c1201fc59 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:25.926729 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c710a260-3556-43cf-a781-6c8c1201fc59 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:25.927713 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c710a260-3556-43cf-a781-6c8c1201fc59 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:25.928353 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c710a260-3556-43cf-a781-6c8c1201fc59 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:26.139612 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-c710a260-3556-43cf-a781-6c8c1201fc59 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:26.148905 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-c710a260-3556-43cf-a781-6c8c1201fc59 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1261 microversion: 2.1 time: 0.239276 Jun 27 18:49:26.150447 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 281/562] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:25 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1261 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:26.337406 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7f4f0670-8c44-4a3c-ae4f-c5324bf5b30f tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:26.339203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-7f4f0670-8c44-4a3c-ae4f-c5324bf5b30f tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: 59583dbe-f7e7-4143-8192-b51ce91c7739] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:26.346812 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7f4f0670-8c44-4a3c-ae4f-c5324bf5b30f tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:26.347261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7f4f0670-8c44-4a3c-ae4f-c5324bf5b30f tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:26.348218 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7f4f0670-8c44-4a3c-ae4f-c5324bf5b30f tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:26.348787 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7f4f0670-8c44-4a3c-ae4f-c5324bf5b30f tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:26.441361 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-7f4f0670-8c44-4a3c-ae4f-c5324bf5b30f tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:26.455312 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-7f4f0670-8c44-4a3c-ae4f-c5324bf5b30f tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739" status: 200 len: 1276 microversion: 2.1 time: 0.121360 Jun 27 18:49:26.469101 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 282/563] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:26 2022] GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:26.818141 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-9399764c-9ac5-4102-b1c7-b97ae7121c2f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-240754475", "imageRef": "c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9615186-335c-44fc-8fc0-824989497b78"}], "security_groups": [{"name": "tempest-securitygroup--55122445"}], "key_name": "tempest-keypair-112762027", "user_data": "}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:49:26.946275 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.network.neutron [None req-9399764c-9ac5-4102-b1c7-b97ae7121c2f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] validate_networks() for [('c9615186-335c-44fc-8fc0-824989497b78', None, None, None, None, None)] {{(pid=124717) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 18:49:27.173854 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-9231312f-dc38-4f6a-a0c7-368695af02d3 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:27.175233 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-9231312f-dc38-4f6a-a0c7-368695af02d3 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:27.199203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9231312f-dc38-4f6a-a0c7-368695af02d3 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:27.201192 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9231312f-dc38-4f6a-a0c7-368695af02d3 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:27.205808 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9231312f-dc38-4f6a-a0c7-368695af02d3 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:27.210871 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9231312f-dc38-4f6a-a0c7-368695af02d3 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:27.479465 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-9231312f-dc38-4f6a-a0c7-368695af02d3 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:27.490734 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-9231312f-dc38-4f6a-a0c7-368695af02d3 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1261 microversion: 2.1 time: 0.324579 Jun 27 18:49:27.491624 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 283/564] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:27 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1261 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:27.513164 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f61de57a-bec3-4df3-af8e-6c0bff4e6804 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:27.513820 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f61de57a-bec3-4df3-af8e-6c0bff4e6804 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: 59583dbe-f7e7-4143-8192-b51ce91c7739] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:27.525808 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f61de57a-bec3-4df3-af8e-6c0bff4e6804 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:27.526288 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f61de57a-bec3-4df3-af8e-6c0bff4e6804 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:27.527152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f61de57a-bec3-4df3-af8e-6c0bff4e6804 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:27.527596 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f61de57a-bec3-4df3-af8e-6c0bff4e6804 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:27.537030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-9399764c-9ac5-4102-b1c7-b97ae7121c2f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Flavor limits 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 18:49:27.537476 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-9399764c-9ac5-4102-b1c7-b97ae7121c2f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Image limits 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 18:49:27.537946 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-9399764c-9ac5-4102-b1c7-b97ae7121c2f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Flavor pref 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 18:49:27.538361 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-9399764c-9ac5-4102-b1c7-b97ae7121c2f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Image pref 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 18:49:27.538801 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-9399764c-9ac5-4102-b1c7-b97ae7121c2f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 18:49:27.552029 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9399764c-9ac5-4102-b1c7-b97ae7121c2f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:27.554466 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9399764c-9ac5-4102-b1c7-b97ae7121c2f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:27.554466 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9399764c-9ac5-4102-b1c7-b97ae7121c2f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:27.554466 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9399764c-9ac5-4102-b1c7-b97ae7121c2f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:27.586962 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-9399764c-9ac5-4102-b1c7-b97ae7121c2f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Getting quotas for project 80ec901270bc4375b22fba22ed2ff68c. Resources: {'ram', 'cores', 'instances'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:49:27.591669 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-9399764c-9ac5-4102-b1c7-b97ae7121c2f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Getting quotas for user f6d74ace9f674f0da40cb35f39d559c9 and project 80ec901270bc4375b22fba22ed2ff68c. Resources: {'ram', 'cores', 'instances'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:49:27.605383 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-9399764c-9ac5-4102-b1c7-b97ae7121c2f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Going to run 1 instances... {{(pid=124717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 18:49:27.608045 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-9399764c-9ac5-4102-b1c7-b97ae7121c2f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 18:49:27.728006 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-9399764c-9ac5-4102-b1c7-b97ae7121c2f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.913909 Jun 27 18:49:27.729084 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 282/565] 10.222.0.15 () {62 vars in 1187 bytes} [Mon Jun 27 18:49:26 2022] POST /compute/v2.1/servers => generated 400 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 27 18:49:27.740190 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-6b794ce8-d7e4-4cdf-aad8-e4bf3c83b939 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:27.741781 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-6b794ce8-d7e4-4cdf-aad8-e4bf3c83b939 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:27.767267 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f61de57a-bec3-4df3-af8e-6c0bff4e6804 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:27.783013 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f61de57a-bec3-4df3-af8e-6c0bff4e6804 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739" status: 200 len: 1318 microversion: 2.1 time: 0.290131 Jun 27 18:49:27.783831 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 284/566] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:27 2022] GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:27.795830 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-6a7e05c0-08c4-4d44-a152-b8963f9e07e5 req-ad84637d-acb4-4052-9c1e-07a8502d64bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59583dbe-f7e7-4143-8192-b51ce91c7739", "tag": "1d67e516-23d0-49cd-8cd5-f0823531fb87"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:49:27.820700 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-6a7e05c0-08c4-4d44-a152-b8963f9e07e5 req-ad84637d-acb4-4052-9c1e-07a8502d64bb service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:27.821433 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-6a7e05c0-08c4-4d44-a152-b8963f9e07e5 req-ad84637d-acb4-4052-9c1e-07a8502d64bb service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:27.839640 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-6a7e05c0-08c4-4d44-a152-b8963f9e07e5 req-ad84637d-acb4-4052-9c1e-07a8502d64bb service nova] Creating event network-changed:1d67e516-23d0-49cd-8cd5-f0823531fb87 for instance 59583dbe-f7e7-4143-8192-b51ce91c7739 on hv-cinder-84460 Jun 27 18:49:27.851712 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-6b794ce8-d7e4-4cdf-aad8-e4bf3c83b939 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:27.862339 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-6a7e05c0-08c4-4d44-a152-b8963f9e07e5 req-ad84637d-acb4-4052-9c1e-07a8502d64bb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076813 Jun 27 18:49:27.862768 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-6b794ce8-d7e4-4cdf-aad8-e4bf3c83b939 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:27.862905 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 285/567] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:49:27.865205 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-6b794ce8-d7e4-4cdf-aad8-e4bf3c83b939 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:27.866570 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-6b794ce8-d7e4-4cdf-aad8-e4bf3c83b939 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1280 microversion: 2.20 time: 0.130864 Jun 27 18:49:27.867632 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 283/568] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:49:27 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1280 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:49:28.514727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-e02a68e5-4dd2-4b51-8199-d89431a3bf77 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:28.515657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-e02a68e5-4dd2-4b51-8199-d89431a3bf77 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:28.532198 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e02a68e5-4dd2-4b51-8199-d89431a3bf77 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:28.535648 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e02a68e5-4dd2-4b51-8199-d89431a3bf77 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:28.536765 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e02a68e5-4dd2-4b51-8199-d89431a3bf77 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:28.537434 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e02a68e5-4dd2-4b51-8199-d89431a3bf77 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:28.712954 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-e02a68e5-4dd2-4b51-8199-d89431a3bf77 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:28.722930 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-e02a68e5-4dd2-4b51-8199-d89431a3bf77 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1261 microversion: 2.1 time: 0.212908 Jun 27 18:49:28.723695 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 286/569] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:28 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1261 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:28.800144 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-bbab6a95-e00c-4edc-a719-ab460e8685a7 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:28.801099 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-bbab6a95-e00c-4edc-a719-ab460e8685a7 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: 59583dbe-f7e7-4143-8192-b51ce91c7739] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:28.809114 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bbab6a95-e00c-4edc-a719-ab460e8685a7 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:28.812271 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bbab6a95-e00c-4edc-a719-ab460e8685a7 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:28.812271 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bbab6a95-e00c-4edc-a719-ab460e8685a7 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:28.812271 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bbab6a95-e00c-4edc-a719-ab460e8685a7 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:28.886526 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7ac7645f-b76b-4d48-9b9c-5fbe0e625f6e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:28.888206 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-7ac7645f-b76b-4d48-9b9c-5fbe0e625f6e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:28.895766 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7ac7645f-b76b-4d48-9b9c-5fbe0e625f6e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:28.898516 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7ac7645f-b76b-4d48-9b9c-5fbe0e625f6e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:28.898516 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7ac7645f-b76b-4d48-9b9c-5fbe0e625f6e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:28.898516 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7ac7645f-b76b-4d48-9b9c-5fbe0e625f6e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:28.996080 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-7ac7645f-b76b-4d48-9b9c-5fbe0e625f6e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:29.006874 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-7ac7645f-b76b-4d48-9b9c-5fbe0e625f6e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:29.008777 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-7ac7645f-b76b-4d48-9b9c-5fbe0e625f6e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:29.010345 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-7ac7645f-b76b-4d48-9b9c-5fbe0e625f6e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1284 microversion: 2.20 time: 0.127633 Jun 27 18:49:29.010683 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 287/570] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:49:28 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:49:29.024058 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-bbab6a95-e00c-4edc-a719-ab460e8685a7 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:29.031824 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-bbab6a95-e00c-4edc-a719-ab460e8685a7 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739" status: 200 len: 1318 microversion: 2.1 time: 0.236068 Jun 27 18:49:29.032385 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 284/571] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:28 2022] GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:29.750582 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-3cbfc6cf-edbe-40ae-a727-8cdcbbd85e41 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:29.750978 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-3cbfc6cf-edbe-40ae-a727-8cdcbbd85e41 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:29.757878 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3cbfc6cf-edbe-40ae-a727-8cdcbbd85e41 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:29.758331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3cbfc6cf-edbe-40ae-a727-8cdcbbd85e41 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:29.759127 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3cbfc6cf-edbe-40ae-a727-8cdcbbd85e41 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:29.759566 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3cbfc6cf-edbe-40ae-a727-8cdcbbd85e41 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:29.908464 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3cbfc6cf-edbe-40ae-a727-8cdcbbd85e41 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:29.916067 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-3cbfc6cf-edbe-40ae-a727-8cdcbbd85e41 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1261 microversion: 2.1 time: 0.175117 Jun 27 18:49:29.916625 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 288/572] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:29 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1261 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:30.027905 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0ef4f560-c859-4a81-8fc6-754aba9fe4eb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:30.028530 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-0ef4f560-c859-4a81-8fc6-754aba9fe4eb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:30.036444 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0ef4f560-c859-4a81-8fc6-754aba9fe4eb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:30.036898 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0ef4f560-c859-4a81-8fc6-754aba9fe4eb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:30.037666 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0ef4f560-c859-4a81-8fc6-754aba9fe4eb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:30.038102 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0ef4f560-c859-4a81-8fc6-754aba9fe4eb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:30.049680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-bf6ccc80-0b44-4021-bcb0-a1ee54337fe0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:30.050402 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-bf6ccc80-0b44-4021-bcb0-a1ee54337fe0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: 59583dbe-f7e7-4143-8192-b51ce91c7739] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:30.061677 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bf6ccc80-0b44-4021-bcb0-a1ee54337fe0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:30.062928 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bf6ccc80-0b44-4021-bcb0-a1ee54337fe0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:30.063874 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bf6ccc80-0b44-4021-bcb0-a1ee54337fe0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:30.064317 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bf6ccc80-0b44-4021-bcb0-a1ee54337fe0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:30.116351 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-0ef4f560-c859-4a81-8fc6-754aba9fe4eb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:30.123991 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-0ef4f560-c859-4a81-8fc6-754aba9fe4eb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:30.125883 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-0ef4f560-c859-4a81-8fc6-754aba9fe4eb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:30.127054 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-0ef4f560-c859-4a81-8fc6-754aba9fe4eb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1276 microversion: 2.20 time: 0.103077 Jun 27 18:49:30.127649 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 285/573] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:49:30 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1276 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:49:30.209943 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-bf6ccc80-0b44-4021-bcb0-a1ee54337fe0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:30.217387 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-bf6ccc80-0b44-4021-bcb0-a1ee54337fe0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739" status: 200 len: 1318 microversion: 2.1 time: 0.172813 Jun 27 18:49:30.218496 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 289/574] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:30 2022] GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:49:30.933073 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-ebd53d12-de1c-4d45-a27c-dcbfa21331c6 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:30.933804 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-ebd53d12-de1c-4d45-a27c-dcbfa21331c6 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:30.940553 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ebd53d12-de1c-4d45-a27c-dcbfa21331c6 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:30.941002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ebd53d12-de1c-4d45-a27c-dcbfa21331c6 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:30.941789 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ebd53d12-de1c-4d45-a27c-dcbfa21331c6 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:30.942222 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ebd53d12-de1c-4d45-a27c-dcbfa21331c6 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:31.085965 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-ebd53d12-de1c-4d45-a27c-dcbfa21331c6 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:31.094153 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-ebd53d12-de1c-4d45-a27c-dcbfa21331c6 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1261 microversion: 2.1 time: 0.164258 Jun 27 18:49:31.094896 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 286/575] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:30 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:31.145756 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-3bf85350-72b9-4414-887a-b8ef8fa768f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:31.146426 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-3bf85350-72b9-4414-887a-b8ef8fa768f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:31.153049 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3bf85350-72b9-4414-887a-b8ef8fa768f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:31.156829 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3bf85350-72b9-4414-887a-b8ef8fa768f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:31.156829 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3bf85350-72b9-4414-887a-b8ef8fa768f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:31.156829 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3bf85350-72b9-4414-887a-b8ef8fa768f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:31.180490 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=100 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:49:31.232656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3bf85350-72b9-4414-887a-b8ef8fa768f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:31.236293 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-241307b8-e622-4536-a244-94e063c2e7a0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:31.237067 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-241307b8-e622-4536-a244-94e063c2e7a0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: 59583dbe-f7e7-4143-8192-b51ce91c7739] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:31.241445 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3bf85350-72b9-4414-887a-b8ef8fa768f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:31.243116 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3bf85350-72b9-4414-887a-b8ef8fa768f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:31.244083 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-241307b8-e622-4536-a244-94e063c2e7a0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:31.244288 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-3bf85350-72b9-4414-887a-b8ef8fa768f6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1338 microversion: 2.20 time: 0.102705 Jun 27 18:49:31.244861 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-241307b8-e622-4536-a244-94e063c2e7a0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:31.245713 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-241307b8-e622-4536-a244-94e063c2e7a0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:31.246229 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-241307b8-e622-4536-a244-94e063c2e7a0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:31.250309 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 290/576] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:49:31 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1338 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:49:31.409128 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-241307b8-e622-4536-a244-94e063c2e7a0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:31.416827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-241307b8-e622-4536-a244-94e063c2e7a0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739" status: 200 len: 1318 microversion: 2.1 time: 0.185757 Jun 27 18:49:31.417503 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 287/577] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:31 2022] GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:49:32.113835 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-db605728-703a-4e5d-a662-87f3bea01315 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:32.115552 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-db605728-703a-4e5d-a662-87f3bea01315 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:32.125020 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-db605728-703a-4e5d-a662-87f3bea01315 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:32.125911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-db605728-703a-4e5d-a662-87f3bea01315 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:32.127298 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-db605728-703a-4e5d-a662-87f3bea01315 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:32.127930 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-db605728-703a-4e5d-a662-87f3bea01315 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:32.269014 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-db605728-703a-4e5d-a662-87f3bea01315 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:32.271128 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-4167a243-59ce-4e5f-8c06-efbedac20991 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:32.271128 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-4167a243-59ce-4e5f-8c06-efbedac20991 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:32.277314 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4167a243-59ce-4e5f-8c06-efbedac20991 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:32.277605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-db605728-703a-4e5d-a662-87f3bea01315 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1261 microversion: 2.1 time: 0.169682 Jun 27 18:49:32.278165 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4167a243-59ce-4e5f-8c06-efbedac20991 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:32.278459 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 291/578] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:32 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:32.281134 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4167a243-59ce-4e5f-8c06-efbedac20991 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:32.281815 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4167a243-59ce-4e5f-8c06-efbedac20991 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:32.434238 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-dad02bdc-c09b-4d88-9120-dd83667b7564 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:32.435368 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-dad02bdc-c09b-4d88-9120-dd83667b7564 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: 59583dbe-f7e7-4143-8192-b51ce91c7739] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:32.438663 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-4167a243-59ce-4e5f-8c06-efbedac20991 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:32.442808 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-dad02bdc-c09b-4d88-9120-dd83667b7564 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:32.443474 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-dad02bdc-c09b-4d88-9120-dd83667b7564 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:32.444533 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-dad02bdc-c09b-4d88-9120-dd83667b7564 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:32.444964 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-dad02bdc-c09b-4d88-9120-dd83667b7564 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:32.454113 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-4167a243-59ce-4e5f-8c06-efbedac20991 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:32.457018 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-4167a243-59ce-4e5f-8c06-efbedac20991 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:32.458434 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-4167a243-59ce-4e5f-8c06-efbedac20991 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1404 microversion: 2.20 time: 0.194607 Jun 27 18:49:32.459170 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 288/579] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:49:32 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1404 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:49:32.591688 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-dad02bdc-c09b-4d88-9120-dd83667b7564 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:32.602522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-dad02bdc-c09b-4d88-9120-dd83667b7564 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739" status: 200 len: 1318 microversion: 2.1 time: 0.172624 Jun 27 18:49:32.603710 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 292/580] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:32 2022] GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:49:32.649035 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-ebb34bcb-a21c-45c4-b75d-8c4e56b53b03 req-a21db38f-c0a1-4a18-95bd-5a54d02ddd9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed77686-7baf-499a-9104-4bfe284ad76b", "tag": "c771ad0c-04e1-4dea-b13c-fbcf24ecd5ac"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:49:32.658405 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-ebb34bcb-a21c-45c4-b75d-8c4e56b53b03 req-a21db38f-c0a1-4a18-95bd-5a54d02ddd9c service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:32.660124 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-ebb34bcb-a21c-45c4-b75d-8c4e56b53b03 req-a21db38f-c0a1-4a18-95bd-5a54d02ddd9c service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:32.672026 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-ebb34bcb-a21c-45c4-b75d-8c4e56b53b03 req-a21db38f-c0a1-4a18-95bd-5a54d02ddd9c service nova] Creating event network-changed:c771ad0c-04e1-4dea-b13c-fbcf24ecd5ac for instance 3ed77686-7baf-499a-9104-4bfe284ad76b on hv-cinder-84460 Jun 27 18:49:32.677678 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-ebb34bcb-a21c-45c4-b75d-8c4e56b53b03 req-a21db38f-c0a1-4a18-95bd-5a54d02ddd9c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032321 Jun 27 18:49:32.678285 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 289/581] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:49:33.296016 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-75f157d7-d9e9-4396-900b-b0a23f4b0728 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:33.297238 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-75f157d7-d9e9-4396-900b-b0a23f4b0728 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:33.299503 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=2 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:49:33.300208 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=8 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:49:33.305667 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-75f157d7-d9e9-4396-900b-b0a23f4b0728 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:33.306238 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-75f157d7-d9e9-4396-900b-b0a23f4b0728 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:33.307147 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-75f157d7-d9e9-4396-900b-b0a23f4b0728 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:33.307591 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-75f157d7-d9e9-4396-900b-b0a23f4b0728 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:33.446354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-75f157d7-d9e9-4396-900b-b0a23f4b0728 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:33.454726 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-75f157d7-d9e9-4396-900b-b0a23f4b0728 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1261 microversion: 2.1 time: 0.162973 Jun 27 18:49:33.456921 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 293/582] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:33 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:33.478282 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-5b64f34b-1d98-4cc6-a410-4edf2d90d873 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:33.479057 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-5b64f34b-1d98-4cc6-a410-4edf2d90d873 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:33.486513 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5b64f34b-1d98-4cc6-a410-4edf2d90d873 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:33.486963 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5b64f34b-1d98-4cc6-a410-4edf2d90d873 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:33.487715 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5b64f34b-1d98-4cc6-a410-4edf2d90d873 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:33.488148 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5b64f34b-1d98-4cc6-a410-4edf2d90d873 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:33.617750 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-5b64f34b-1d98-4cc6-a410-4edf2d90d873 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:33.620635 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-eeb6cf1b-3ea0-45c8-99f3-a88de095f80f tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:33.621264 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-eeb6cf1b-3ea0-45c8-99f3-a88de095f80f tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: 59583dbe-f7e7-4143-8192-b51ce91c7739] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:33.626733 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-5b64f34b-1d98-4cc6-a410-4edf2d90d873 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:33.628032 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-eeb6cf1b-3ea0-45c8-99f3-a88de095f80f tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:33.628248 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-5b64f34b-1d98-4cc6-a410-4edf2d90d873 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:33.628480 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-eeb6cf1b-3ea0-45c8-99f3-a88de095f80f tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:33.629231 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-eeb6cf1b-3ea0-45c8-99f3-a88de095f80f tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:33.629403 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-5b64f34b-1d98-4cc6-a410-4edf2d90d873 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1404 microversion: 2.20 time: 0.155982 Jun 27 18:49:33.629664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-eeb6cf1b-3ea0-45c8-99f3-a88de095f80f tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:33.629986 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 290/583] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:49:33 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:49:33.767243 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-eeb6cf1b-3ea0-45c8-99f3-a88de095f80f tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:33.774934 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-eeb6cf1b-3ea0-45c8-99f3-a88de095f80f tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739" status: 200 len: 1318 microversion: 2.1 time: 0.158375 Jun 27 18:49:33.775505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 294/584] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:33 2022] GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:49:34.408926 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-bef768e7-c107-426b-9136-fe676e494803 req-498c634d-e25e-4217-ab81-4844201d254b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59583dbe-f7e7-4143-8192-b51ce91c7739", "name": "network-vif-plugged", "status": "completed", "tag": "1d67e516-23d0-49cd-8cd5-f0823531fb87"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:49:34.417547 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-bef768e7-c107-426b-9136-fe676e494803 req-498c634d-e25e-4217-ab81-4844201d254b service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:34.418795 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-bef768e7-c107-426b-9136-fe676e494803 req-498c634d-e25e-4217-ab81-4844201d254b service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:34.430089 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-bef768e7-c107-426b-9136-fe676e494803 req-498c634d-e25e-4217-ab81-4844201d254b service nova] Creating event network-vif-plugged:1d67e516-23d0-49cd-8cd5-f0823531fb87 for instance 59583dbe-f7e7-4143-8192-b51ce91c7739 on hv-cinder-84460 Jun 27 18:49:34.435933 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-bef768e7-c107-426b-9136-fe676e494803 req-498c634d-e25e-4217-ab81-4844201d254b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030756 Jun 27 18:49:34.436519 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 291/585] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:49:34.473858 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-48869cab-077c-4dba-8a7c-d1b8889f2016 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:34.474987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-48869cab-077c-4dba-8a7c-d1b8889f2016 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:34.481282 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-48869cab-077c-4dba-8a7c-d1b8889f2016 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:34.481737 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-48869cab-077c-4dba-8a7c-d1b8889f2016 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:34.482558 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-48869cab-077c-4dba-8a7c-d1b8889f2016 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:34.483243 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-48869cab-077c-4dba-8a7c-d1b8889f2016 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:34.645335 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-48869cab-077c-4dba-8a7c-d1b8889f2016 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:34.647913 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-4d39a0ce-0876-43fc-8fe9-1e58d692a232 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:34.648627 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-4d39a0ce-0876-43fc-8fe9-1e58d692a232 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:34.653889 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-48869cab-077c-4dba-8a7c-d1b8889f2016 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1261 microversion: 2.1 time: 0.186019 Jun 27 18:49:34.654473 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 295/586] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:34 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1261 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:34.656507 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4d39a0ce-0876-43fc-8fe9-1e58d692a232 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:34.657035 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4d39a0ce-0876-43fc-8fe9-1e58d692a232 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:34.657997 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4d39a0ce-0876-43fc-8fe9-1e58d692a232 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:34.658470 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4d39a0ce-0876-43fc-8fe9-1e58d692a232 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:34.792965 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a85e4e8e-a665-405d-9386-cdf38872ce91 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:34.793850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a85e4e8e-a665-405d-9386-cdf38872ce91 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: 59583dbe-f7e7-4143-8192-b51ce91c7739] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:34.800761 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a85e4e8e-a665-405d-9386-cdf38872ce91 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:34.805007 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a85e4e8e-a665-405d-9386-cdf38872ce91 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:34.805007 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a85e4e8e-a665-405d-9386-cdf38872ce91 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:34.805007 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a85e4e8e-a665-405d-9386-cdf38872ce91 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:34.821079 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-4d39a0ce-0876-43fc-8fe9-1e58d692a232 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:34.830980 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-4d39a0ce-0876-43fc-8fe9-1e58d692a232 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:34.832790 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-4d39a0ce-0876-43fc-8fe9-1e58d692a232 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:34.834140 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-4d39a0ce-0876-43fc-8fe9-1e58d692a232 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1404 microversion: 2.20 time: 0.190544 Jun 27 18:49:34.834970 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 292/587] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:49:34 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1404 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:49:34.949162 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a85e4e8e-a665-405d-9386-cdf38872ce91 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:34.956639 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a85e4e8e-a665-405d-9386-cdf38872ce91 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739" status: 200 len: 1318 microversion: 2.1 time: 0.167561 Jun 27 18:49:34.957206 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 296/588] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:34 2022] GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:49:35.671705 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-045c7096-218f-4736-9d5c-ff85d6d80766 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:35.672428 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-045c7096-218f-4736-9d5c-ff85d6d80766 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:35.679449 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-045c7096-218f-4736-9d5c-ff85d6d80766 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:35.679905 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-045c7096-218f-4736-9d5c-ff85d6d80766 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:35.680694 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-045c7096-218f-4736-9d5c-ff85d6d80766 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:35.681134 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-045c7096-218f-4736-9d5c-ff85d6d80766 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:35.813665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-045c7096-218f-4736-9d5c-ff85d6d80766 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:35.821113 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-045c7096-218f-4736-9d5c-ff85d6d80766 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1261 microversion: 2.1 time: 0.153468 Jun 27 18:49:35.821673 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 293/589] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:35 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:49:35.854595 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7fdcc396-abf7-4a24-b157-26e5ee3d0b14 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:35.855210 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-7fdcc396-abf7-4a24-b157-26e5ee3d0b14 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:35.862089 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7fdcc396-abf7-4a24-b157-26e5ee3d0b14 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:35.862653 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7fdcc396-abf7-4a24-b157-26e5ee3d0b14 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:35.863422 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7fdcc396-abf7-4a24-b157-26e5ee3d0b14 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:35.863853 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7fdcc396-abf7-4a24-b157-26e5ee3d0b14 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:35.973986 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-65f6b164-2bae-4c15-859f-388c994f29c6 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:35.976220 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-65f6b164-2bae-4c15-859f-388c994f29c6 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: 59583dbe-f7e7-4143-8192-b51ce91c7739] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:35.981270 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-65f6b164-2bae-4c15-859f-388c994f29c6 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:35.981718 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-65f6b164-2bae-4c15-859f-388c994f29c6 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:35.982519 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-65f6b164-2bae-4c15-859f-388c994f29c6 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:35.982953 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-65f6b164-2bae-4c15-859f-388c994f29c6 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:36.000774 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-7fdcc396-abf7-4a24-b157-26e5ee3d0b14 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:36.008800 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-7fdcc396-abf7-4a24-b157-26e5ee3d0b14 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:36.010507 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-7fdcc396-abf7-4a24-b157-26e5ee3d0b14 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:36.011643 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-7fdcc396-abf7-4a24-b157-26e5ee3d0b14 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1404 microversion: 2.20 time: 0.161011 Jun 27 18:49:36.012215 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 297/590] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:49:35 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:49:36.113150 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-65f6b164-2bae-4c15-859f-388c994f29c6 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:36.120441 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-65f6b164-2bae-4c15-859f-388c994f29c6 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739" status: 200 len: 1318 microversion: 2.1 time: 0.151264 Jun 27 18:49:36.121000 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 294/591] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:35 2022] GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:49:36.452072 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-767fb459-5d14-406b-b24b-b60449531188 req-dedd3305-23d2-4bfc-a401-d7d5250cb250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a731689-b26b-4f41-a3d3-4d1a2ebff239", "name": "network-vif-plugged", "status": "completed", "tag": "d446f8e5-97d8-434f-9b91-31d20061c950"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:49:36.462529 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-767fb459-5d14-406b-b24b-b60449531188 req-dedd3305-23d2-4bfc-a401-d7d5250cb250 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:36.462972 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-767fb459-5d14-406b-b24b-b60449531188 req-dedd3305-23d2-4bfc-a401-d7d5250cb250 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:36.474714 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-767fb459-5d14-406b-b24b-b60449531188 req-dedd3305-23d2-4bfc-a401-d7d5250cb250 service nova] Creating event network-vif-plugged:d446f8e5-97d8-434f-9b91-31d20061c950 for instance 2a731689-b26b-4f41-a3d3-4d1a2ebff239 on hv-cinder-84460 Jun 27 18:49:36.479762 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-767fb459-5d14-406b-b24b-b60449531188 req-dedd3305-23d2-4bfc-a401-d7d5250cb250 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032525 Jun 27 18:49:36.480338 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 298/592] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:49:36.838336 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-34d6418e-749d-47fb-a92b-f3381065e921 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:36.839145 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-34d6418e-749d-47fb-a92b-f3381065e921 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:36.845859 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-34d6418e-749d-47fb-a92b-f3381065e921 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:36.846313 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-34d6418e-749d-47fb-a92b-f3381065e921 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:36.847225 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-34d6418e-749d-47fb-a92b-f3381065e921 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:36.847665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-34d6418e-749d-47fb-a92b-f3381065e921 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:36.983901 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-34d6418e-749d-47fb-a92b-f3381065e921 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:36.992160 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-34d6418e-749d-47fb-a92b-f3381065e921 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1261 microversion: 2.1 time: 0.157660 Jun 27 18:49:36.997045 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 295/593] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:36 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:37.030888 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-4b2ae1c7-3390-497d-956d-e9db569a9aac tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:37.031613 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-4b2ae1c7-3390-497d-956d-e9db569a9aac tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:37.038805 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4b2ae1c7-3390-497d-956d-e9db569a9aac tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:37.039289 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4b2ae1c7-3390-497d-956d-e9db569a9aac tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:37.040043 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4b2ae1c7-3390-497d-956d-e9db569a9aac tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:37.040476 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4b2ae1c7-3390-497d-956d-e9db569a9aac tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:37.138023 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-8856f95a-7b5e-4966-ba09-c0e4d09f7835 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:37.138776 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-8856f95a-7b5e-4966-ba09-c0e4d09f7835 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: 59583dbe-f7e7-4143-8192-b51ce91c7739] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:37.144819 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8856f95a-7b5e-4966-ba09-c0e4d09f7835 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:37.145274 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8856f95a-7b5e-4966-ba09-c0e4d09f7835 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:37.146043 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8856f95a-7b5e-4966-ba09-c0e4d09f7835 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:37.146505 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8856f95a-7b5e-4966-ba09-c0e4d09f7835 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:37.161042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=100 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:49:37.171124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-4b2ae1c7-3390-497d-956d-e9db569a9aac tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:37.179716 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-4b2ae1c7-3390-497d-956d-e9db569a9aac tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:37.181244 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-4b2ae1c7-3390-497d-956d-e9db569a9aac tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:37.182418 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-4b2ae1c7-3390-497d-956d-e9db569a9aac tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1404 microversion: 2.20 time: 0.155883 Jun 27 18:49:37.182979 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 299/594] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:49:37 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:49:37.277532 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-8856f95a-7b5e-4966-ba09-c0e4d09f7835 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:37.285287 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-8856f95a-7b5e-4966-ba09-c0e4d09f7835 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739" status: 200 len: 1507 microversion: 2.1 time: 0.150944 Jun 27 18:49:37.285785 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 296/595] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:37 2022] GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:37.302068 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-35a34491-2b5e-47b5-a388-dbfd89b43c22 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60831bc6-6d72-4cd6-86de-e1e544ebd621", "device": "/dev/sdb"}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:49:37.303204 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-35a34491-2b5e-47b5-a388-dbfd89b43c22 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: 59583dbe-f7e7-4143-8192-b51ce91c7739] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:37.309124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-35a34491-2b5e-47b5-a388-dbfd89b43c22 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:37.309571 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-35a34491-2b5e-47b5-a388-dbfd89b43c22 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:37.310329 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-35a34491-2b5e-47b5-a388-dbfd89b43c22 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:37.310793 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-35a34491-2b5e-47b5-a388-dbfd89b43c22 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:38.009028 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-2bf8c61f-fe64-4f76-be09-14aecfdab9ee tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:38.009636 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-2bf8c61f-fe64-4f76-be09-14aecfdab9ee tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:38.011522 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell0:SELECT=2 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:49:38.012652 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell0:SELECT=12 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:49:38.017577 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2bf8c61f-fe64-4f76-be09-14aecfdab9ee tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:38.018021 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2bf8c61f-fe64-4f76-be09-14aecfdab9ee tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:38.018800 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2bf8c61f-fe64-4f76-be09-14aecfdab9ee tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:38.019233 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2bf8c61f-fe64-4f76-be09-14aecfdab9ee tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:38.152523 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-2bf8c61f-fe64-4f76-be09-14aecfdab9ee tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:38.160410 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-2bf8c61f-fe64-4f76-be09-14aecfdab9ee tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1261 microversion: 2.1 time: 0.155243 Jun 27 18:49:38.160976 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 297/596] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:38 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:38.201034 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-3bbd5c87-066f-4c18-99fc-353b19864aa5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:38.201652 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-3bbd5c87-066f-4c18-99fc-353b19864aa5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:38.208415 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3bbd5c87-066f-4c18-99fc-353b19864aa5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:38.208869 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3bbd5c87-066f-4c18-99fc-353b19864aa5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:38.209698 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3bbd5c87-066f-4c18-99fc-353b19864aa5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:38.210111 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3bbd5c87-066f-4c18-99fc-353b19864aa5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:38.345996 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-3bbd5c87-066f-4c18-99fc-353b19864aa5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:38.354014 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-3bbd5c87-066f-4c18-99fc-353b19864aa5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:38.355587 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-3bbd5c87-066f-4c18-99fc-353b19864aa5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:38.356704 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-3bbd5c87-066f-4c18-99fc-353b19864aa5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1404 microversion: 2.20 time: 0.159664 Jun 27 18:49:38.360652 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 298/597] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:49:38 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:49:38.486807 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-35a34491-2b5e-47b5-a388-dbfd89b43c22 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "POST /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.188965 Jun 27 18:49:38.487411 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 300/598] 10.222.0.15 () {60 vars in 1322 bytes} [Mon Jun 27 18:49:37 2022] POST /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739/os-volume_attachments => generated 194 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:49:39.177334 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-6de83a46-4a2a-4369-bb1b-6c55d11ec984 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:39.177885 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-6de83a46-4a2a-4369-bb1b-6c55d11ec984 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:39.184448 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6de83a46-4a2a-4369-bb1b-6c55d11ec984 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:39.184897 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6de83a46-4a2a-4369-bb1b-6c55d11ec984 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:39.185664 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6de83a46-4a2a-4369-bb1b-6c55d11ec984 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:39.186104 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6de83a46-4a2a-4369-bb1b-6c55d11ec984 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:39.322262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-6de83a46-4a2a-4369-bb1b-6c55d11ec984 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:39.330149 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-6de83a46-4a2a-4369-bb1b-6c55d11ec984 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1445 microversion: 2.1 time: 0.156905 Jun 27 18:49:39.330948 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 299/599] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:39 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1445 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:39.349957 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-151e13e6-373a-4d47-acf6-dd6e2a1ad9eb tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:39.350683 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-151e13e6-373a-4d47-acf6-dd6e2a1ad9eb tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:39.357308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-151e13e6-373a-4d47-acf6-dd6e2a1ad9eb tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:39.357749 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-151e13e6-373a-4d47-acf6-dd6e2a1ad9eb tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:39.358852 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-151e13e6-373a-4d47-acf6-dd6e2a1ad9eb tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:39.359335 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-151e13e6-373a-4d47-acf6-dd6e2a1ad9eb tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:39.376583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-dc2a0136-b2e7-4542-916e-f4861081d7b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:39.377197 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-dc2a0136-b2e7-4542-916e-f4861081d7b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:39.383554 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-dc2a0136-b2e7-4542-916e-f4861081d7b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:39.384002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-dc2a0136-b2e7-4542-916e-f4861081d7b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:39.384769 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-dc2a0136-b2e7-4542-916e-f4861081d7b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:39.385383 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-dc2a0136-b2e7-4542-916e-f4861081d7b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:39.572180 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-151e13e6-373a-4d47-acf6-dd6e2a1ad9eb tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:39.576184 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-dc2a0136-b2e7-4542-916e-f4861081d7b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:39.583705 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-151e13e6-373a-4d47-acf6-dd6e2a1ad9eb tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1445 microversion: 2.1 time: 0.237944 Jun 27 18:49:39.584538 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-dc2a0136-b2e7-4542-916e-f4861081d7b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:39.584824 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 301/600] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:49:39 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1445 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:49:39.588351 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-dc2a0136-b2e7-4542-916e-f4861081d7b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:39.589517 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-dc2a0136-b2e7-4542-916e-f4861081d7b5 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1404 microversion: 2.20 time: 0.217567 Jun 27 18:49:39.590274 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 300/601] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:49:39 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1404 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:49:39.760100 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-e6151c0e-cfc9-45f8-a297-af6e050cc2cf req-ac7306f4-f929-4286-bc41-4c9461230873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed77686-7baf-499a-9104-4bfe284ad76b", "name": "network-vif-plugged", "status": "completed", "tag": "c771ad0c-04e1-4dea-b13c-fbcf24ecd5ac"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:49:39.768668 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-e6151c0e-cfc9-45f8-a297-af6e050cc2cf req-ac7306f4-f929-4286-bc41-4c9461230873 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:39.769110 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-e6151c0e-cfc9-45f8-a297-af6e050cc2cf req-ac7306f4-f929-4286-bc41-4c9461230873 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:39.779849 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-e6151c0e-cfc9-45f8-a297-af6e050cc2cf req-ac7306f4-f929-4286-bc41-4c9461230873 service nova] Creating event network-vif-plugged:c771ad0c-04e1-4dea-b13c-fbcf24ecd5ac for instance 3ed77686-7baf-499a-9104-4bfe284ad76b on hv-cinder-84460 Jun 27 18:49:39.785793 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-e6151c0e-cfc9-45f8-a297-af6e050cc2cf req-ac7306f4-f929-4286-bc41-4c9461230873 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029501 Jun 27 18:49:39.787980 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 302/602] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:49:40.610972 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-31ba2b10-7f90-46bb-9ee5-841f3f1a919f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:40.611631 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-31ba2b10-7f90-46bb-9ee5-841f3f1a919f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:40.618624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-31ba2b10-7f90-46bb-9ee5-841f3f1a919f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:40.619286 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-31ba2b10-7f90-46bb-9ee5-841f3f1a919f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:40.620065 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-31ba2b10-7f90-46bb-9ee5-841f3f1a919f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:40.620505 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-31ba2b10-7f90-46bb-9ee5-841f3f1a919f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:40.769657 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-31ba2b10-7f90-46bb-9ee5-841f3f1a919f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:40.777864 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-31ba2b10-7f90-46bb-9ee5-841f3f1a919f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:40.779400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-31ba2b10-7f90-46bb-9ee5-841f3f1a919f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:40.781442 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-31ba2b10-7f90-46bb-9ee5-841f3f1a919f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1404 microversion: 2.20 time: 0.175126 Jun 27 18:49:40.782990 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 301/603] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:49:40 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1404 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:49:41.803713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-fd46d95a-ba72-48fb-a48b-46f872171a63 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:41.804412 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-fd46d95a-ba72-48fb-a48b-46f872171a63 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:41.811148 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd46d95a-ba72-48fb-a48b-46f872171a63 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:41.811598 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd46d95a-ba72-48fb-a48b-46f872171a63 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:41.812357 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd46d95a-ba72-48fb-a48b-46f872171a63 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:41.812801 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd46d95a-ba72-48fb-a48b-46f872171a63 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:41.951851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-fd46d95a-ba72-48fb-a48b-46f872171a63 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:41.960970 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-fd46d95a-ba72-48fb-a48b-46f872171a63 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:41.962605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-fd46d95a-ba72-48fb-a48b-46f872171a63 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:41.963979 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-fd46d95a-ba72-48fb-a48b-46f872171a63 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1404 microversion: 2.20 time: 0.164580 Jun 27 18:49:41.964832 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 303/604] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:49:41 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1404 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:49:42.049435 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-04f86018-76d3-480d-a8e2-2227d2b631f9 req-4256f2b7-74f1-41ca-b98e-b75dc5bcb554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a731689-b26b-4f41-a3d3-4d1a2ebff239", "tag": "d446f8e5-97d8-434f-9b91-31d20061c950"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:49:42.058279 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-04f86018-76d3-480d-a8e2-2227d2b631f9 req-4256f2b7-74f1-41ca-b98e-b75dc5bcb554 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:42.058770 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-04f86018-76d3-480d-a8e2-2227d2b631f9 req-4256f2b7-74f1-41ca-b98e-b75dc5bcb554 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:42.070435 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-04f86018-76d3-480d-a8e2-2227d2b631f9 req-4256f2b7-74f1-41ca-b98e-b75dc5bcb554 service nova] Creating event network-changed:d446f8e5-97d8-434f-9b91-31d20061c950 for instance 2a731689-b26b-4f41-a3d3-4d1a2ebff239 on hv-cinder-84460 Jun 27 18:49:42.075361 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-04f86018-76d3-480d-a8e2-2227d2b631f9 req-4256f2b7-74f1-41ca-b98e-b75dc5bcb554 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030658 Jun 27 18:49:42.075962 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 302/605] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:49:42.981994 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-372d9787-5fda-4dfa-b2b6-d3d873ad8ead tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:42.982628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-372d9787-5fda-4dfa-b2b6-d3d873ad8ead tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:42.990123 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-372d9787-5fda-4dfa-b2b6-d3d873ad8ead tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:42.990914 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-372d9787-5fda-4dfa-b2b6-d3d873ad8ead tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:42.991426 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-372d9787-5fda-4dfa-b2b6-d3d873ad8ead tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:42.991798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-372d9787-5fda-4dfa-b2b6-d3d873ad8ead tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:43.122070 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-372d9787-5fda-4dfa-b2b6-d3d873ad8ead tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:43.130850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-372d9787-5fda-4dfa-b2b6-d3d873ad8ead tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:43.132376 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-372d9787-5fda-4dfa-b2b6-d3d873ad8ead tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:49:43.133540 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-372d9787-5fda-4dfa-b2b6-d3d873ad8ead tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1596 microversion: 2.20 time: 0.155455 Jun 27 18:49:43.134104 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 304/606] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:49:42 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1596 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:49:43.152081 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e00a3b7f-c16c-46ee-8f1d-25d9b6130f04 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:43.153224 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e00a3b7f-c16c-46ee-8f1d-25d9b6130f04 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:43.159313 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e00a3b7f-c16c-46ee-8f1d-25d9b6130f04 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:43.159767 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e00a3b7f-c16c-46ee-8f1d-25d9b6130f04 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:43.160537 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e00a3b7f-c16c-46ee-8f1d-25d9b6130f04 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:43.160977 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e00a3b7f-c16c-46ee-8f1d-25d9b6130f04 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:43.238505 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e00a3b7f-c16c-46ee-8f1d-25d9b6130f04 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091207 Jun 27 18:49:43.239215 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 303/607] 10.222.0.15 () {60 vars in 1315 bytes} [Mon Jun 27 18:49:43 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 18:49:44.228782 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-76f551d7-68e3-4a41-ac33-2e786b045475 req-652e27cc-dcfa-4793-8ddf-7517d54b7e79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed77686-7baf-499a-9104-4bfe284ad76b", "tag": "c771ad0c-04e1-4dea-b13c-fbcf24ecd5ac"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:49:44.238514 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-76f551d7-68e3-4a41-ac33-2e786b045475 req-652e27cc-dcfa-4793-8ddf-7517d54b7e79 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:44.239047 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-76f551d7-68e3-4a41-ac33-2e786b045475 req-652e27cc-dcfa-4793-8ddf-7517d54b7e79 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:44.249736 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-76f551d7-68e3-4a41-ac33-2e786b045475 req-652e27cc-dcfa-4793-8ddf-7517d54b7e79 service nova] Creating event network-changed:c771ad0c-04e1-4dea-b13c-fbcf24ecd5ac for instance 3ed77686-7baf-499a-9104-4bfe284ad76b on hv-cinder-84460 Jun 27 18:49:44.255462 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-76f551d7-68e3-4a41-ac33-2e786b045475 req-652e27cc-dcfa-4793-8ddf-7517d54b7e79 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030434 Jun 27 18:49:44.256047 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 305/608] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:49:55.227069 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:49:55.227837 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=39 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:49:55.232072 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-93e1c5bd-cb3d-4516-80cb-6a164f12735f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d66330ca-4ecf-4547-b489-87b0ed173b79"}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:49:55.233192 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-93e1c5bd-cb3d-4516-80cb-6a164f12735f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:55.239864 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-93e1c5bd-cb3d-4516-80cb-6a164f12735f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:55.240310 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-93e1c5bd-cb3d-4516-80cb-6a164f12735f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:55.241066 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-93e1c5bd-cb3d-4516-80cb-6a164f12735f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:55.241505 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-93e1c5bd-cb3d-4516-80cb-6a164f12735f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:55.901612 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-93e1c5bd-cb3d-4516-80cb-6a164f12735f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "POST /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.675969 Jun 27 18:49:55.902448 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 304/609] 10.222.0.15 () {60 vars in 1322 bytes} [Mon Jun 27 18:49:55 2022] POST /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb/os-volume_attachments => generated 194 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:49:58.497878 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:49:58.498649 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:49:58.502875 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-c1b2d50a-ee88-46a9-86ee-f0086aaa8c46 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:49:58.503447 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-c1b2d50a-ee88-46a9-86ee-f0086aaa8c46 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: 59583dbe-f7e7-4143-8192-b51ce91c7739] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:49:58.509765 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c1b2d50a-ee88-46a9-86ee-f0086aaa8c46 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:58.511056 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c1b2d50a-ee88-46a9-86ee-f0086aaa8c46 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:58.511056 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c1b2d50a-ee88-46a9-86ee-f0086aaa8c46 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:49:58.511449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c1b2d50a-ee88-46a9-86ee-f0086aaa8c46 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:49:58.592344 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.objects.instance [None req-c1b2d50a-ee88-46a9-86ee-f0086aaa8c46 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lazy-loading 'services' on Instance uuid 59583dbe-f7e7-4143-8192-b51ce91c7739 {{(pid=124716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:49:58.748061 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-c1b2d50a-ee88-46a9-86ee-f0086aaa8c46 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "DELETE /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739/os-volume_attachments/60831bc6-6d72-4cd6-86de-e1e544ebd621" status: 202 len: 0 microversion: 2.1 time: 0.251460 Jun 27 18:49:58.748669 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 306/610] 10.222.0.15 () {58 vars in 1415 bytes} [Mon Jun 27 18:49:58 2022] DELETE /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739/os-volume_attachments/60831bc6-6d72-4cd6-86de-e1e544ebd621 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:50:03.407032 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-8f88a30f-722f-4f4e-898a-4e0ebef51429 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:50:03.408064 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-8f88a30f-722f-4f4e-898a-4e0ebef51429 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:03.414289 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8f88a30f-722f-4f4e-898a-4e0ebef51429 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:03.417104 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8f88a30f-722f-4f4e-898a-4e0ebef51429 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:03.417104 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8f88a30f-722f-4f4e-898a-4e0ebef51429 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:03.417104 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8f88a30f-722f-4f4e-898a-4e0ebef51429 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:03.438352 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.objects.instance [None req-8f88a30f-722f-4f4e-898a-4e0ebef51429 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lazy-loading 'flavor' on Instance uuid c18b111d-f2de-41ac-8ae4-6738845259fb {{(pid=124717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:50:03.822215 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-8f88a30f-722f-4f4e-898a-4e0ebef51429 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "POST /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb/action" status: 200 len: 32 microversion: 2.1 time: 0.420081 Jun 27 18:50:03.822861 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 305/611] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Jun 27 18:50:03 2022] POST /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb/action => generated 32 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 18:50:03.832889 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-4fb91617-e11f-41d2-9bbf-ebde5c34944a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:03.833595 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-4fb91617-e11f-41d2-9bbf-ebde5c34944a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:03.840082 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4fb91617-e11f-41d2-9bbf-ebde5c34944a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:03.840536 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4fb91617-e11f-41d2-9bbf-ebde5c34944a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:03.841304 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4fb91617-e11f-41d2-9bbf-ebde5c34944a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:03.841739 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4fb91617-e11f-41d2-9bbf-ebde5c34944a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:04.099375 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-4fb91617-e11f-41d2-9bbf-ebde5c34944a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:04.108324 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-4fb91617-e11f-41d2-9bbf-ebde5c34944a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1733 microversion: 2.1 time: 0.280281 Jun 27 18:50:04.108887 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 307/612] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:03 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1733 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:05.128434 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-afa06bcd-7115-4d29-9d18-5d3890315715 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:05.129432 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-afa06bcd-7115-4d29-9d18-5d3890315715 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:05.136347 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-d8cc4798-d5d4-4860-866b-dc5afafafa17 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:05.136829 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-d8cc4798-d5d4-4860-866b-dc5afafafa17 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: 59583dbe-f7e7-4143-8192-b51ce91c7739] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:05.136997 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-afa06bcd-7115-4d29-9d18-5d3890315715 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:05.137453 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-afa06bcd-7115-4d29-9d18-5d3890315715 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:05.138373 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-afa06bcd-7115-4d29-9d18-5d3890315715 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:05.138691 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-afa06bcd-7115-4d29-9d18-5d3890315715 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:05.143685 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d8cc4798-d5d4-4860-866b-dc5afafafa17 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:05.144141 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d8cc4798-d5d4-4860-866b-dc5afafafa17 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:05.144907 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d8cc4798-d5d4-4860-866b-dc5afafafa17 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:05.145344 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d8cc4798-d5d4-4860-866b-dc5afafafa17 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:05.171890 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-d8cc4798-d5d4-4860-866b-dc5afafafa17 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: 59583dbe-f7e7-4143-8192-b51ce91c7739] Going to try to terminate instance {{(pid=124716) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 18:50:05.340395 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-afa06bcd-7115-4d29-9d18-5d3890315715 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:05.348550 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-afa06bcd-7115-4d29-9d18-5d3890315715 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1733 microversion: 2.1 time: 0.225990 Jun 27 18:50:05.349116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 306/613] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:05 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1733 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:05.470589 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-d8cc4798-d5d4-4860-866b-dc5afafafa17 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "DELETE /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739" status: 204 len: 0 microversion: 2.1 time: 0.337986 Jun 27 18:50:05.471218 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 308/614] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:50:05 2022] DELETE /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 18:50:05.480222 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-38c96e7d-7728-4971-b03a-c66dea0350b6 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:05.481148 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-38c96e7d-7728-4971-b03a-c66dea0350b6 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: 59583dbe-f7e7-4143-8192-b51ce91c7739] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:05.487221 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-38c96e7d-7728-4971-b03a-c66dea0350b6 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:05.487716 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-38c96e7d-7728-4971-b03a-c66dea0350b6 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:05.488478 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-38c96e7d-7728-4971-b03a-c66dea0350b6 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:05.488918 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-38c96e7d-7728-4971-b03a-c66dea0350b6 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:05.620071 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-38c96e7d-7728-4971-b03a-c66dea0350b6 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:05.627457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-38c96e7d-7728-4971-b03a-c66dea0350b6 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739" status: 200 len: 1513 microversion: 2.1 time: 0.151809 Jun 27 18:50:05.628018 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 307/615] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:05 2022] GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:06.367640 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-93d0eb5d-56c0-4729-88d4-71a97cc79591 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:06.368472 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-93d0eb5d-56c0-4729-88d4-71a97cc79591 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:06.374893 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-93d0eb5d-56c0-4729-88d4-71a97cc79591 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:06.375340 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-93d0eb5d-56c0-4729-88d4-71a97cc79591 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:06.376286 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-93d0eb5d-56c0-4729-88d4-71a97cc79591 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:06.376561 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-93d0eb5d-56c0-4729-88d4-71a97cc79591 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:06.511959 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-93d0eb5d-56c0-4729-88d4-71a97cc79591 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:06.519885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-93d0eb5d-56c0-4729-88d4-71a97cc79591 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1733 microversion: 2.1 time: 0.157150 Jun 27 18:50:06.520459 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 309/616] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:06 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:06.645054 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-7f6453eb-02c4-4060-bc98-5cc3a734c9a0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:06.645585 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-7f6453eb-02c4-4060-bc98-5cc3a734c9a0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: 59583dbe-f7e7-4143-8192-b51ce91c7739] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:06.654165 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7f6453eb-02c4-4060-bc98-5cc3a734c9a0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:06.654639 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7f6453eb-02c4-4060-bc98-5cc3a734c9a0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:06.655390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7f6453eb-02c4-4060-bc98-5cc3a734c9a0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:06.655821 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7f6453eb-02c4-4060-bc98-5cc3a734c9a0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:06.990847 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-7f6453eb-02c4-4060-bc98-5cc3a734c9a0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:06.998332 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-7f6453eb-02c4-4060-bc98-5cc3a734c9a0 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739" status: 200 len: 1513 microversion: 2.1 time: 0.357262 Jun 27 18:50:06.998985 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 308/617] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:06 2022] GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739 => generated 1513 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:07.538106 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-824a795e-9bd8-49b0-91ae-cc2142959752 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:07.539436 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-824a795e-9bd8-49b0-91ae-cc2142959752 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:07.545796 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-824a795e-9bd8-49b0-91ae-cc2142959752 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:07.546238 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-824a795e-9bd8-49b0-91ae-cc2142959752 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:07.547028 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-824a795e-9bd8-49b0-91ae-cc2142959752 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:07.547456 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-824a795e-9bd8-49b0-91ae-cc2142959752 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:07.675466 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-824a795e-9bd8-49b0-91ae-cc2142959752 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:07.683460 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-824a795e-9bd8-49b0-91ae-cc2142959752 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1733 microversion: 2.1 time: 0.149174 Jun 27 18:50:07.684030 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 310/618] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:07 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:08.015583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-ddb7a0f9-ff4e-431c-8da4-439ccadd8685 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:08.016199 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-ddb7a0f9-ff4e-431c-8da4-439ccadd8685 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: 59583dbe-f7e7-4143-8192-b51ce91c7739] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:08.022853 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ddb7a0f9-ff4e-431c-8da4-439ccadd8685 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:08.023940 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ddb7a0f9-ff4e-431c-8da4-439ccadd8685 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:08.024719 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ddb7a0f9-ff4e-431c-8da4-439ccadd8685 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:08.025156 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ddb7a0f9-ff4e-431c-8da4-439ccadd8685 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:08.107120 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-ddb7a0f9-ff4e-431c-8da4-439ccadd8685 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f17909688f40f9b752e63b4074c2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5284ec5970e14418bfbd5391ee3b282c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:08.108387 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-1d5ec981-fdab-4e08-8aa0-28b2c69ed746 req-2aa1438f-905d-442f-a484-758cd07dcac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59583dbe-f7e7-4143-8192-b51ce91c7739", "name": "network-vif-deleted", "tag": "1d67e516-23d0-49cd-8cd5-f0823531fb87"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:50:08.115448 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-ddb7a0f9-ff4e-431c-8da4-439ccadd8685 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739" status: 200 len: 1471 microversion: 2.1 time: 0.103715 Jun 27 18:50:08.116308 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 309/619] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:08 2022] GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739 => generated 1471 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:08.119189 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-1d5ec981-fdab-4e08-8aa0-28b2c69ed746 req-2aa1438f-905d-442f-a484-758cd07dcac6 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:08.119702 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-1d5ec981-fdab-4e08-8aa0-28b2c69ed746 req-2aa1438f-905d-442f-a484-758cd07dcac6 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:08.133051 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-1d5ec981-fdab-4e08-8aa0-28b2c69ed746 req-2aa1438f-905d-442f-a484-758cd07dcac6 service nova] Creating event network-vif-deleted:1d67e516-23d0-49cd-8cd5-f0823531fb87 for instance 59583dbe-f7e7-4143-8192-b51ce91c7739 on hv-cinder-84460 Jun 27 18:50:08.138206 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-1d5ec981-fdab-4e08-8aa0-28b2c69ed746 req-2aa1438f-905d-442f-a484-758cd07dcac6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034246 Jun 27 18:50:08.138934 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 311/620] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:50:08.701305 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-5da863bc-875e-4fb7-a1bb-5f84c5869d89 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:08.701958 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-5da863bc-875e-4fb7-a1bb-5f84c5869d89 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:08.707909 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5da863bc-875e-4fb7-a1bb-5f84c5869d89 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:08.708381 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5da863bc-875e-4fb7-a1bb-5f84c5869d89 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:08.709211 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5da863bc-875e-4fb7-a1bb-5f84c5869d89 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:08.709659 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5da863bc-875e-4fb7-a1bb-5f84c5869d89 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:08.843441 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-5da863bc-875e-4fb7-a1bb-5f84c5869d89 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:08.852223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-5da863bc-875e-4fb7-a1bb-5f84c5869d89 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1733 microversion: 2.1 time: 0.154486 Jun 27 18:50:08.858319 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 310/621] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:08 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:09.137368 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-8da93948-f911-4dfa-b7db-49dca1755129 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:09.138134 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-8da93948-f911-4dfa-b7db-49dca1755129 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] [instance: 59583dbe-f7e7-4143-8192-b51ce91c7739] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:09.144776 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8da93948-f911-4dfa-b7db-49dca1755129 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:09.145220 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8da93948-f911-4dfa-b7db-49dca1755129 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:09.145978 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8da93948-f911-4dfa-b7db-49dca1755129 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:09.146462 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8da93948-f911-4dfa-b7db-49dca1755129 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:09.160734 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-8da93948-f911-4dfa-b7db-49dca1755129 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] HTTP exception thrown: Instance 59583dbe-f7e7-4143-8192-b51ce91c7739 could not be found. Jun 27 18:50:09.162605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-8da93948-f911-4dfa-b7db-49dca1755129 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Request method failure captured: Jun 27 18:50:09.162605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739 HTTP/1.1 Jun 27 18:50:09.162605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:50:09.162605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:50:09.162605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:50:09.162605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:50:09.162605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:50:09.162605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:50:09.162605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:50:09.162605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:50:09.162605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiuftUjWWxrg_Yq1pNEgv2Q0Sc6AHn93XN1rfll7IfeTJqkzXCgN4C0ehKZhuv3KJVTcxnAris1MZVFcgpzBC_hZ1TkczV6dIgL5OvRqg6cCrUd3drd4GDaNtAmh0IIPfDTmL6ScN8c1r-G4iWQdqyyTAm1NZ_eW_9Fdbh5r1YNgGhD-Y Jun 27 18:50:09.162605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:50:09.162605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:50:09.162605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:50:09.162605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:50:09.162605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:50:09.162605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:50:09.162605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: 5284ec5970e14418bfbd5391ee3b282c Jun 27 18:50:09.162605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1292741423 Jun 27 18:50:09.162605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:50:09.162605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:50:09.164798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5284ec5970e14418bfbd5391ee3b282c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5284ec5970e14418bfbd5391ee3b282c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5284ec5970e14418bfbd5391ee3b282c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5284ec5970e14418bfbd5391ee3b282c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:50:09.164798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-VolumesSnapshotTestJSON-1292741423 Jun 27 18:50:09.164798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: 5284ec5970e14418bfbd5391ee3b282c Jun 27 18:50:09.164798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1292741423 Jun 27 18:50:09.164798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-VolumesSnapshotTestJSON-1292741423-project Jun 27 18:50:09.164798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:50:09.164798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:50:09.164798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: f5f17909688f40f9b752e63b4074c2ee Jun 27 18:50:09.164798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-VolumesSnapshotTestJSON-1292741423-project Jun 27 18:50:09.164798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: > Jun 27 18:50:09.164798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Instance 59583dbe-f7e7-4143-8192-b51ce91c7739 could not be found. Jun 27 18:50:09.164798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': '59583dbe-f7e7-4143-8192-b51ce91c7739'} Jun 27 18:50:09.165729 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:50:09.165729 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:50:09.165729 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:50:09.165729 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:50:09.165729 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:50:09.165729 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:50:09.165729 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:50:09.165729 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:50:09.165729 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:50:09.165729 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:50:09.165729 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59583dbe-f7e7-4143-8192-b51ce91c7739 could not be found. Jun 27 18:50:09.165729 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:50:09.165729 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:50:09.165729 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:50:09.165729 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:50:09.165729 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:50:09.165729 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:50:09.165729 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:50:09.165729 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:50:09.165729 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:50:09.167449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:50:09.167449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:50:09.167449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:50:09.167449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:50:09.167449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:50:09.167449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:50:09.167449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:50:09.167449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59583dbe-f7e7-4143-8192-b51ce91c7739 could not be found. Jun 27 18:50:09.167449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:50:09.167449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:50:09.167449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:50:09.167449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:50:09.167449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:50:09.167449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:50:09.167449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:50:09.167449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:50:09.167449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59583dbe-f7e7-4143-8192-b51ce91c7739 could not be found. Jun 27 18:50:09.167449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:50:09.169062 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-8da93948-f911-4dfa-b7db-49dca1755129 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] Returning 404 to user: Instance 59583dbe-f7e7-4143-8192-b51ce91c7739 could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:50:09.169062 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-8da93948-f911-4dfa-b7db-49dca1755129 tempest-VolumesSnapshotTestJSON-1292741423 tempest-VolumesSnapshotTestJSON-1292741423-project] 10.222.0.15 "GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739" status: 404 len: 111 microversion: 2.1 time: 0.034225 Jun 27 18:50:09.169062 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 312/622] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:09 2022] GET /compute/v2.1/servers/59583dbe-f7e7-4143-8192-b51ce91c7739 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:50:09.870107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-d0de56c2-e82c-4a94-8fd2-ab4adb3b1830 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:09.870690 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-d0de56c2-e82c-4a94-8fd2-ab4adb3b1830 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:09.877198 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d0de56c2-e82c-4a94-8fd2-ab4adb3b1830 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:09.877650 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d0de56c2-e82c-4a94-8fd2-ab4adb3b1830 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:09.878506 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d0de56c2-e82c-4a94-8fd2-ab4adb3b1830 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:09.878952 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d0de56c2-e82c-4a94-8fd2-ab4adb3b1830 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:10.010647 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-d0de56c2-e82c-4a94-8fd2-ab4adb3b1830 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:10.018534 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-d0de56c2-e82c-4a94-8fd2-ab4adb3b1830 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1733 microversion: 2.1 time: 0.152524 Jun 27 18:50:10.019106 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 311/623] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:09 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:11.036009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-4471683b-bc3e-4320-8fff-92fa9e7e047d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:11.039306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-4471683b-bc3e-4320-8fff-92fa9e7e047d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:11.052376 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4471683b-bc3e-4320-8fff-92fa9e7e047d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:11.052825 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4471683b-bc3e-4320-8fff-92fa9e7e047d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:11.053603 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4471683b-bc3e-4320-8fff-92fa9e7e047d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:11.054039 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4471683b-bc3e-4320-8fff-92fa9e7e047d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:11.186498 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-4471683b-bc3e-4320-8fff-92fa9e7e047d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:11.194410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-4471683b-bc3e-4320-8fff-92fa9e7e047d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1733 microversion: 2.1 time: 0.162274 Jun 27 18:50:11.195085 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 313/624] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:11 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:12.212592 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-9381babf-e33f-43b7-9020-1042f22b7a2d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:12.213213 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-9381babf-e33f-43b7-9020-1042f22b7a2d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:12.223008 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9381babf-e33f-43b7-9020-1042f22b7a2d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:12.223490 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9381babf-e33f-43b7-9020-1042f22b7a2d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:12.224255 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9381babf-e33f-43b7-9020-1042f22b7a2d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:12.224688 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9381babf-e33f-43b7-9020-1042f22b7a2d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:12.356630 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-9381babf-e33f-43b7-9020-1042f22b7a2d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:12.364689 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-9381babf-e33f-43b7-9020-1042f22b7a2d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1733 microversion: 2.1 time: 0.157031 Jun 27 18:50:12.365254 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 312/625] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:12 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:13.382324 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-e1aaa577-8583-4577-8098-e28ba15c99f1 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:13.383286 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-e1aaa577-8583-4577-8098-e28ba15c99f1 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:13.389402 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e1aaa577-8583-4577-8098-e28ba15c99f1 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:13.389852 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e1aaa577-8583-4577-8098-e28ba15c99f1 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:13.390649 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e1aaa577-8583-4577-8098-e28ba15c99f1 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:13.391092 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e1aaa577-8583-4577-8098-e28ba15c99f1 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:13.521668 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-e1aaa577-8583-4577-8098-e28ba15c99f1 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:13.529854 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-e1aaa577-8583-4577-8098-e28ba15c99f1 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1733 microversion: 2.1 time: 0.151441 Jun 27 18:50:13.530440 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 314/626] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:13 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:14.256610 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-3e766130-57dd-4f54-9bb7-003467a475da tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:14.258127 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-3e766130-57dd-4f54-9bb7-003467a475da tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:14.264766 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3e766130-57dd-4f54-9bb7-003467a475da tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:14.265210 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3e766130-57dd-4f54-9bb7-003467a475da tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:14.265966 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3e766130-57dd-4f54-9bb7-003467a475da tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:14.266426 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3e766130-57dd-4f54-9bb7-003467a475da tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:14.295364 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-3e766130-57dd-4f54-9bb7-003467a475da tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042649 Jun 27 18:50:14.297260 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 313/627] 10.222.0.15 () {58 vars in 1301 bytes} [Mon Jun 27 18:50:14 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 18:50:14.354945 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-3c326f3f-e8a3-46be-ab03-b5da8403b97e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:14.355438 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-3c326f3f-e8a3-46be-ab03-b5da8403b97e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:14.361558 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3c326f3f-e8a3-46be-ab03-b5da8403b97e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:14.362002 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3c326f3f-e8a3-46be-ab03-b5da8403b97e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:14.362788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3c326f3f-e8a3-46be-ab03-b5da8403b97e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:14.363219 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3c326f3f-e8a3-46be-ab03-b5da8403b97e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:14.387809 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-3c326f3f-e8a3-46be-ab03-b5da8403b97e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Going to try to terminate instance {{(pid=124716) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 18:50:14.547298 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-ff711a04-c31e-4c9e-bea8-2f9ca384b8da tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:14.547971 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-ff711a04-c31e-4c9e-bea8-2f9ca384b8da tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:14.553776 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ff711a04-c31e-4c9e-bea8-2f9ca384b8da tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:14.554245 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ff711a04-c31e-4c9e-bea8-2f9ca384b8da tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:14.555087 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ff711a04-c31e-4c9e-bea8-2f9ca384b8da tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:14.555521 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ff711a04-c31e-4c9e-bea8-2f9ca384b8da tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:14.642329 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-3c326f3f-e8a3-46be-ab03-b5da8403b97e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 204 len: 0 microversion: 2.1 time: 0.291963 Jun 27 18:50:14.642981 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 315/628] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:50:14 2022] DELETE /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 18:50:14.652617 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-1ab386e1-d66d-4164-973d-29b66379c13b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:14.653389 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-1ab386e1-d66d-4164-973d-29b66379c13b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:14.659524 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1ab386e1-d66d-4164-973d-29b66379c13b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:14.659872 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1ab386e1-d66d-4164-973d-29b66379c13b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:14.661186 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1ab386e1-d66d-4164-973d-29b66379c13b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:14.661186 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1ab386e1-d66d-4164-973d-29b66379c13b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:14.687178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-ff711a04-c31e-4c9e-bea8-2f9ca384b8da tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:14.695297 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-ff711a04-c31e-4c9e-bea8-2f9ca384b8da tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1733 microversion: 2.1 time: 0.151719 Jun 27 18:50:14.695942 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 314/629] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:14 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:50:14.802453 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-1ab386e1-d66d-4164-973d-29b66379c13b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:14.810677 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-1ab386e1-d66d-4164-973d-29b66379c13b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1672 microversion: 2.1 time: 0.162910 Jun 27 18:50:14.811327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 316/630] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:14 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:50:15.713109 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e3df4c39-08ff-472f-a4a4-eabf524c2406 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:15.713762 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e3df4c39-08ff-472f-a4a4-eabf524c2406 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:15.720527 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e3df4c39-08ff-472f-a4a4-eabf524c2406 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:15.720978 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e3df4c39-08ff-472f-a4a4-eabf524c2406 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:15.721752 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e3df4c39-08ff-472f-a4a4-eabf524c2406 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:15.722190 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e3df4c39-08ff-472f-a4a4-eabf524c2406 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:15.828958 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-e548ba18-e385-4195-b889-712500ac7e1d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:15.829566 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-e548ba18-e385-4195-b889-712500ac7e1d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:15.836763 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e548ba18-e385-4195-b889-712500ac7e1d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:15.837205 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e548ba18-e385-4195-b889-712500ac7e1d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:15.837964 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e548ba18-e385-4195-b889-712500ac7e1d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:15.838411 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e548ba18-e385-4195-b889-712500ac7e1d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:15.856826 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-e3df4c39-08ff-472f-a4a4-eabf524c2406 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:15.865267 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e3df4c39-08ff-472f-a4a4-eabf524c2406 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1733 microversion: 2.1 time: 0.156202 Jun 27 18:50:15.865870 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 315/631] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:15 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:15.967809 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-e548ba18-e385-4195-b889-712500ac7e1d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:15.975113 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-e548ba18-e385-4195-b889-712500ac7e1d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1672 microversion: 2.1 time: 0.150218 Jun 27 18:50:15.975679 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 317/632] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:15 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:50:16.882169 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-9692b608-d423-4935-818c-5234c43c12c7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:16.883375 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-9692b608-d423-4935-818c-5234c43c12c7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:16.889765 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9692b608-d423-4935-818c-5234c43c12c7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:16.890219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9692b608-d423-4935-818c-5234c43c12c7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:16.891555 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9692b608-d423-4935-818c-5234c43c12c7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:16.891555 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9692b608-d423-4935-818c-5234c43c12c7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:16.994495 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-ebdd0fd1-0522-4774-80b7-aa73ee8708e9 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:16.995280 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-ebdd0fd1-0522-4774-80b7-aa73ee8708e9 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:17.001980 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ebdd0fd1-0522-4774-80b7-aa73ee8708e9 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:17.002721 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ebdd0fd1-0522-4774-80b7-aa73ee8708e9 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:17.003661 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ebdd0fd1-0522-4774-80b7-aa73ee8708e9 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:17.004273 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ebdd0fd1-0522-4774-80b7-aa73ee8708e9 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:17.113659 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-9692b608-d423-4935-818c-5234c43c12c7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:17.123371 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-9692b608-d423-4935-818c-5234c43c12c7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1733 microversion: 2.1 time: 0.245091 Jun 27 18:50:17.123950 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 316/633] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:16 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1733 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:17.237422 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-ebdd0fd1-0522-4774-80b7-aa73ee8708e9 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:17.247932 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-ebdd0fd1-0522-4774-80b7-aa73ee8708e9 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1672 microversion: 2.1 time: 0.258550 Jun 27 18:50:17.253850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 318/634] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:16 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1672 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:50:18.043635 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-e8ae3f41-7527-4484-88fa-33f64b099c15 req-ebc3e266-88d6-44e2-818e-05dbfe81d810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd4240ca-4c5b-441f-b4f3-659defed4c91", "name": "network-vif-deleted", "tag": "41a01167-c069-4cd5-8459-b0f4a8178e28"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:50:18.052351 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-e8ae3f41-7527-4484-88fa-33f64b099c15 req-ebc3e266-88d6-44e2-818e-05dbfe81d810 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:18.053043 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-e8ae3f41-7527-4484-88fa-33f64b099c15 req-ebc3e266-88d6-44e2-818e-05dbfe81d810 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:18.057543 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:18.064990 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-e8ae3f41-7527-4484-88fa-33f64b099c15 req-ebc3e266-88d6-44e2-818e-05dbfe81d810 service nova] Creating event network-vif-deleted:41a01167-c069-4cd5-8459-b0f4a8178e28 for instance bd4240ca-4c5b-441f-b4f3-659defed4c91 on hv-cinder-84460 Jun 27 18:50:18.070182 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-e8ae3f41-7527-4484-88fa-33f64b099c15 req-ebc3e266-88d6-44e2-818e-05dbfe81d810 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031237 Jun 27 18:50:18.071236 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 317/635] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:50:18.142094 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-11ff739c-0b4d-43ca-aaf2-3fb3308f4cb9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:18.142763 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-11ff739c-0b4d-43ca-aaf2-3fb3308f4cb9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:18.154416 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-11ff739c-0b4d-43ca-aaf2-3fb3308f4cb9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:18.155292 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-11ff739c-0b4d-43ca-aaf2-3fb3308f4cb9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:18.156602 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-11ff739c-0b4d-43ca-aaf2-3fb3308f4cb9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:18.157470 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-11ff739c-0b4d-43ca-aaf2-3fb3308f4cb9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:18.268769 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-9599f93d-e524-4e9f-9153-d6d328f39710 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:18.269570 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-9599f93d-e524-4e9f-9153-d6d328f39710 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:18.280663 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9599f93d-e524-4e9f-9153-d6d328f39710 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:18.281467 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9599f93d-e524-4e9f-9153-d6d328f39710 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:18.282500 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9599f93d-e524-4e9f-9153-d6d328f39710 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:18.283182 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9599f93d-e524-4e9f-9153-d6d328f39710 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:18.317912 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-11ff739c-0b4d-43ca-aaf2-3fb3308f4cb9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:18.328080 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:18.339853 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-11ff739c-0b4d-43ca-aaf2-3fb3308f4cb9 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1733 microversion: 2.1 time: 0.201315 Jun 27 18:50:18.349634 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 319/636] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:18 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1733 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:18.363796 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-9599f93d-e524-4e9f-9153-d6d328f39710 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:18.372345 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-9599f93d-e524-4e9f-9153-d6d328f39710 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 200 len: 1322 microversion: 2.1 time: 0.109948 Jun 27 18:50:18.373224 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 318/637] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:18 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 1322 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:50:19.357382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-9d95b3d0-8fce-4a51-9fdc-3d001e4ddf24 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:19.358056 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-9d95b3d0-8fce-4a51-9fdc-3d001e4ddf24 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:19.365747 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9d95b3d0-8fce-4a51-9fdc-3d001e4ddf24 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:19.366195 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9d95b3d0-8fce-4a51-9fdc-3d001e4ddf24 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:19.367641 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9d95b3d0-8fce-4a51-9fdc-3d001e4ddf24 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:19.368069 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9d95b3d0-8fce-4a51-9fdc-3d001e4ddf24 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:19.389893 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-2c786de1-e56f-4406-8755-ceb8a76c2349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:19.390543 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-2c786de1-e56f-4406-8755-ceb8a76c2349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:19.397416 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2c786de1-e56f-4406-8755-ceb8a76c2349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:19.397863 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2c786de1-e56f-4406-8755-ceb8a76c2349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:19.398919 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2c786de1-e56f-4406-8755-ceb8a76c2349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:19.399233 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2c786de1-e56f-4406-8755-ceb8a76c2349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:19.413081 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-2c786de1-e56f-4406-8755-ceb8a76c2349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] HTTP exception thrown: Instance bd4240ca-4c5b-441f-b4f3-659defed4c91 could not be found. Jun 27 18:50:19.415320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-2c786de1-e56f-4406-8755-ceb8a76c2349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Request method failure captured: Jun 27 18:50:19.415320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 HTTP/1.1 Jun 27 18:50:19.415320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 18:50:19.415320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 18:50:19.415320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 18:50:19.415320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 0 Jun 27 18:50:19.415320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 18:50:19.415320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 18:50:19.415320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 18:50:19.415320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 18:50:19.415320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufq5gWfZ1Ea8zegAT-oJvN8zf-eLgIVj0uveSKc2BH8nRZrEcnp7ZSOksWqIFeUNFAnR50wp1kDgWmv5crZ9FgowyJm7wrpmLRDruSxUmPUZD5sZkyfYtAilb0PpvFpZ_emCy2snXQeCB_QprvrsSewmqkWZqT8KA2R4gEq0FdwgOvI Jun 27 18:50:19.415320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 18:50:19.415320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 18:50:19.415320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 18:50:19.415320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 18:50:19.415320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 18:50:19.415320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 18:50:19.415320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: 0f19df10a9c948ce9c2e0dfa29532e5a Jun 27 18:50:19.415320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-AttachVolumeTestJSON-680751178 Jun 27 18:50:19.415320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 18:50:19.415320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 18:50:19.416716 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f19df10a9c948ce9c2e0dfa29532e5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f19df10a9c948ce9c2e0dfa29532e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0f19df10a9c948ce9c2e0dfa29532e5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0f19df10a9c948ce9c2e0dfa29532e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:50:19.416716 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-AttachVolumeTestJSON-680751178 Jun 27 18:50:19.416716 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: 0f19df10a9c948ce9c2e0dfa29532e5a Jun 27 18:50:19.416716 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-AttachVolumeTestJSON-680751178 Jun 27 18:50:19.416716 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-AttachVolumeTestJSON-680751178-project Jun 27 18:50:19.416716 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 18:50:19.416716 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 18:50:19.416716 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: 2fc6711e48be4d4ab33695e06c7227ab Jun 27 18:50:19.416716 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-AttachVolumeTestJSON-680751178-project Jun 27 18:50:19.416716 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: > Jun 27 18:50:19.416716 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Instance bd4240ca-4c5b-441f-b4f3-659defed4c91 could not be found. Jun 27 18:50:19.416716 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'id': 'bd4240ca-4c5b-441f-b4f3-659defed4c91'} Jun 27 18:50:19.417540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:50:19.417540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:50:19.417540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:50:19.417540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:50:19.417540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:50:19.417540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:50:19.417540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:50:19.417540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:50:19.417540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:50:19.417540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:50:19.417540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd4240ca-4c5b-441f-b4f3-659defed4c91 could not be found. Jun 27 18:50:19.417540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:50:19.417540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:50:19.417540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:50:19.417540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:50:19.417540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:50:19.417540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:50:19.417540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:50:19.417540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:50:19.417540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:50:19.419265 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:50:19.419265 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:50:19.419265 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:50:19.419265 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:50:19.419265 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:50:19.419265 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:50:19.419265 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:50:19.419265 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd4240ca-4c5b-441f-b4f3-659defed4c91 could not be found. Jun 27 18:50:19.419265 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:50:19.419265 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:50:19.419265 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:50:19.419265 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:50:19.419265 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:50:19.419265 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:50:19.419265 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:50:19.419265 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:50:19.419265 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd4240ca-4c5b-441f-b4f3-659defed4c91 could not be found. Jun 27 18:50:19.419265 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:50:19.420580 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-2c786de1-e56f-4406-8755-ceb8a76c2349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Returning 404 to user: Instance bd4240ca-4c5b-441f-b4f3-659defed4c91 could not be found. {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:50:19.420580 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-2c786de1-e56f-4406-8755-ceb8a76c2349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 404 len: 111 microversion: 2.1 time: 0.031436 Jun 27 18:50:19.420580 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 319/638] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:19 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 18:50:19.425831 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-5d02a4c1-1e57-4a66-88c6-6c3fdc4a1245 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '.version_select at 0x7f700ff2be50>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:19.500638 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-9d95b3d0-8fce-4a51-9fdc-3d001e4ddf24 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:19.509002 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-9d95b3d0-8fce-4a51-9fdc-3d001e4ddf24 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1733 microversion: 2.1 time: 0.155552 Jun 27 18:50:19.509566 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 320/639] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:19 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:50:19.542021 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-5d02a4c1-1e57-4a66-88c6-6c3fdc4a1245 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1722412099" status: 202 len: 0 microversion: 2.1 time: 0.119926 Jun 27 18:50:19.542701 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 320/640] 10.222.0.15 () {58 vars in 1220 bytes} [Mon Jun 27 18:50:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1722412099 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 18:50:20.366716 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-cb4cb8f1-89ff-4bbf-bb63-8260df253ccc tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Action: 'create', calling method: .version_select at 0x7f700f6a5040>, body: {"keypair": {"name": "tempest-keypair-1615449974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOq2lsGPGTMcBpr2oIe3r93ieTpC8fVXw0kM09kTem7wXECxAsc81FMfko97t1vuGVUAjjwqWvbo20EnXF6x1LZ3+fQIMmfw8u8C+lFIf1JvA+U+87/SCr6mRRIabbUXtQ=="}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:50:20.384577 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-cb4cb8f1-89ff-4bbf-bb63-8260df253ccc tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Getting quotas for project 0f19df10a9c948ce9c2e0dfa29532e5a. Resources: {'key_pairs'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:50:20.388352 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-cb4cb8f1-89ff-4bbf-bb63-8260df253ccc tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Getting quotas for user 2fc6711e48be4d4ab33695e06c7227ab and project 0f19df10a9c948ce9c2e0dfa29532e5a. Resources: {'key_pairs'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:50:20.455133 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-cb4cb8f1-89ff-4bbf-bb63-8260df253ccc tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.092742 Jun 27 18:50:20.455739 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 321/641] 10.222.0.15 () {60 vars in 1158 bytes} [Mon Jun 27 18:50:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:50:20.526350 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-04d09228-197a-42f0-9969-edc21f1fd66e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:20.526916 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-04d09228-197a-42f0-9969-edc21f1fd66e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:20.532869 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-04d09228-197a-42f0-9969-edc21f1fd66e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:20.533322 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-04d09228-197a-42f0-9969-edc21f1fd66e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:20.534085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-04d09228-197a-42f0-9969-edc21f1fd66e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:20.534561 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-04d09228-197a-42f0-9969-edc21f1fd66e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:20.669724 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-04d09228-197a-42f0-9969-edc21f1fd66e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:20.678153 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-04d09228-197a-42f0-9969-edc21f1fd66e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1733 microversion: 2.1 time: 0.156330 Jun 27 18:50:20.683596 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 321/642] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:20 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:21.696184 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-19f57e85-6d22-4923-9201-e0b305b50b5e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:21.696724 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-19f57e85-6d22-4923-9201-e0b305b50b5e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:21.705172 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-19f57e85-6d22-4923-9201-e0b305b50b5e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:21.705632 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-19f57e85-6d22-4923-9201-e0b305b50b5e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:21.706459 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-19f57e85-6d22-4923-9201-e0b305b50b5e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:21.706906 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-19f57e85-6d22-4923-9201-e0b305b50b5e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:21.842421 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-19f57e85-6d22-4923-9201-e0b305b50b5e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:21.851304 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-19f57e85-6d22-4923-9201-e0b305b50b5e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1733 microversion: 2.1 time: 0.159138 Jun 27 18:50:21.851892 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 322/643] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:21 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:22.782446 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-b9b3b6ef-8da3-4d17-bddd-45a68d798a6f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1697556009", "imageRef": "c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "74ef6afb-6d6c-4546-b97e-477599f56632"}], "security_groups": [{"name": "tempest-securitygroup--1140213792"}], "key_name": "tempest-keypair-1615449974", "user_data": "}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:50:22.870681 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f2a0ab49-9c5c-4245-97f9-c39abd657873 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:22.871301 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f2a0ab49-9c5c-4245-97f9-c39abd657873 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:22.878453 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f2a0ab49-9c5c-4245-97f9-c39abd657873 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:22.878908 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f2a0ab49-9c5c-4245-97f9-c39abd657873 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:22.879712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f2a0ab49-9c5c-4245-97f9-c39abd657873 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:22.880152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f2a0ab49-9c5c-4245-97f9-c39abd657873 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:22.881635 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.network.neutron [None req-b9b3b6ef-8da3-4d17-bddd-45a68d798a6f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] validate_networks() for [('74ef6afb-6d6c-4546-b97e-477599f56632', None, None, None, None, None)] {{(pid=124717) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 18:50:23.080704 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f2a0ab49-9c5c-4245-97f9-c39abd657873 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:23.089433 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f2a0ab49-9c5c-4245-97f9-c39abd657873 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1733 microversion: 2.1 time: 0.223312 Jun 27 18:50:23.090007 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 323/644] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:22 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1733 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:50:23.365232 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-b9b3b6ef-8da3-4d17-bddd-45a68d798a6f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Flavor limits 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 18:50:23.365660 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-b9b3b6ef-8da3-4d17-bddd-45a68d798a6f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Image limits 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 18:50:23.366134 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-b9b3b6ef-8da3-4d17-bddd-45a68d798a6f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Flavor pref 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 18:50:23.366584 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-b9b3b6ef-8da3-4d17-bddd-45a68d798a6f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Image pref 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 18:50:23.367513 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-b9b3b6ef-8da3-4d17-bddd-45a68d798a6f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 18:50:23.376152 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b9b3b6ef-8da3-4d17-bddd-45a68d798a6f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:23.376601 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b9b3b6ef-8da3-4d17-bddd-45a68d798a6f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:23.377398 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b9b3b6ef-8da3-4d17-bddd-45a68d798a6f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:23.377837 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b9b3b6ef-8da3-4d17-bddd-45a68d798a6f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:23.394584 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-b9b3b6ef-8da3-4d17-bddd-45a68d798a6f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Getting quotas for project 0f19df10a9c948ce9c2e0dfa29532e5a. Resources: {'ram', 'cores', 'instances'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:50:23.398480 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-b9b3b6ef-8da3-4d17-bddd-45a68d798a6f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Getting quotas for user 2fc6711e48be4d4ab33695e06c7227ab and project 0f19df10a9c948ce9c2e0dfa29532e5a. Resources: {'ram', 'cores', 'instances'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:50:23.409241 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-b9b3b6ef-8da3-4d17-bddd-45a68d798a6f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Going to run 1 instances... {{(pid=124717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 18:50:23.411528 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-b9b3b6ef-8da3-4d17-bddd-45a68d798a6f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 18:50:23.537883 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-b9b3b6ef-8da3-4d17-bddd-45a68d798a6f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.759668 Jun 27 18:50:23.538705 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 322/645] 10.222.0.15 () {60 vars in 1146 bytes} [Mon Jun 27 18:50:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 18:50:23.549654 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-502c09ee-c69c-462b-8cba-bbf9a9df0975 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:23.550356 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-502c09ee-c69c-462b-8cba-bbf9a9df0975 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:23.611197 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-502c09ee-c69c-462b-8cba-bbf9a9df0975 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:23.619959 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-502c09ee-c69c-462b-8cba-bbf9a9df0975 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc" status: 200 len: 1238 microversion: 2.1 time: 0.074417 Jun 27 18:50:23.621034 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 324/646] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:23 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:24.107854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-7f3a1623-667c-4f8a-8beb-c87528a81a0e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:24.108471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-7f3a1623-667c-4f8a-8beb-c87528a81a0e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:24.115371 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7f3a1623-667c-4f8a-8beb-c87528a81a0e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:24.115821 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7f3a1623-667c-4f8a-8beb-c87528a81a0e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:24.116578 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7f3a1623-667c-4f8a-8beb-c87528a81a0e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:24.117038 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7f3a1623-667c-4f8a-8beb-c87528a81a0e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:24.251763 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-7f3a1623-667c-4f8a-8beb-c87528a81a0e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:24.260505 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-7f3a1623-667c-4f8a-8beb-c87528a81a0e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1733 microversion: 2.1 time: 0.157132 Jun 27 18:50:24.261075 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 323/647] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:24 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:24.637497 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f3e2b045-5aa1-4d3f-80d7-6760512f000f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:24.638116 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f3e2b045-5aa1-4d3f-80d7-6760512f000f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:24.644677 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f3e2b045-5aa1-4d3f-80d7-6760512f000f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:24.645157 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f3e2b045-5aa1-4d3f-80d7-6760512f000f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:24.645989 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f3e2b045-5aa1-4d3f-80d7-6760512f000f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:24.646458 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f3e2b045-5aa1-4d3f-80d7-6760512f000f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:24.709894 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f3e2b045-5aa1-4d3f-80d7-6760512f000f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:24.720220 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f3e2b045-5aa1-4d3f-80d7-6760512f000f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc" status: 200 len: 1242 microversion: 2.1 time: 0.086582 Jun 27 18:50:24.720800 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 325/648] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:24 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:25.277750 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a1d3bf33-c9a5-4381-8793-bfe81ae2e5ea tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:25.278444 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-a1d3bf33-c9a5-4381-8793-bfe81ae2e5ea tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:25.284756 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a1d3bf33-c9a5-4381-8793-bfe81ae2e5ea tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:25.285205 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a1d3bf33-c9a5-4381-8793-bfe81ae2e5ea tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:25.286002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a1d3bf33-c9a5-4381-8793-bfe81ae2e5ea tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:25.286486 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a1d3bf33-c9a5-4381-8793-bfe81ae2e5ea tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:25.425637 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a1d3bf33-c9a5-4381-8793-bfe81ae2e5ea tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:25.434735 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-a1d3bf33-c9a5-4381-8793-bfe81ae2e5ea tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1733 microversion: 2.1 time: 0.160639 Jun 27 18:50:25.435050 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 324/649] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:25 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:25.737333 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-8715efdc-f6f6-43ef-b842-9cf6e0247993 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:25.737971 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-8715efdc-f6f6-43ef-b842-9cf6e0247993 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:25.745152 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8715efdc-f6f6-43ef-b842-9cf6e0247993 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:25.745596 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8715efdc-f6f6-43ef-b842-9cf6e0247993 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:25.746356 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8715efdc-f6f6-43ef-b842-9cf6e0247993 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:25.746811 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8715efdc-f6f6-43ef-b842-9cf6e0247993 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:25.809284 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-8715efdc-f6f6-43ef-b842-9cf6e0247993 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:25.816856 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-8715efdc-f6f6-43ef-b842-9cf6e0247993 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc" status: 200 len: 1290 microversion: 2.1 time: 0.083691 Jun 27 18:50:25.817419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 326/650] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:25 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc => generated 1290 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:26.452435 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-bf6d5dde-7032-41dd-acda-b3c5e1e82a77 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:26.452972 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-bf6d5dde-7032-41dd-acda-b3c5e1e82a77 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:26.455354 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:26.460097 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bf6d5dde-7032-41dd-acda-b3c5e1e82a77 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:26.460545 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bf6d5dde-7032-41dd-acda-b3c5e1e82a77 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:26.461317 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bf6d5dde-7032-41dd-acda-b3c5e1e82a77 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:26.461830 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bf6d5dde-7032-41dd-acda-b3c5e1e82a77 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:26.689468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-bf6d5dde-7032-41dd-acda-b3c5e1e82a77 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:26.698859 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-bf6d5dde-7032-41dd-acda-b3c5e1e82a77 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1713 microversion: 2.1 time: 0.250475 Jun 27 18:50:26.700301 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 325/651] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:26 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1713 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:26.807609 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-5bed9da7-47ff-4766-9d63-2660ed153427 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:26.808426 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-5bed9da7-47ff-4766-9d63-2660ed153427 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:26.814791 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5bed9da7-47ff-4766-9d63-2660ed153427 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:26.815246 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5bed9da7-47ff-4766-9d63-2660ed153427 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:26.816017 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5bed9da7-47ff-4766-9d63-2660ed153427 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:26.816452 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5bed9da7-47ff-4766-9d63-2660ed153427 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:26.833421 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-982e8876-f104-48a5-841d-d3691d6042a3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:26.834457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-982e8876-f104-48a5-841d-d3691d6042a3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:26.840448 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-982e8876-f104-48a5-841d-d3691d6042a3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:26.840899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-982e8876-f104-48a5-841d-d3691d6042a3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:26.841675 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-982e8876-f104-48a5-841d-d3691d6042a3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:26.842114 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-982e8876-f104-48a5-841d-d3691d6042a3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:26.899939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-5bed9da7-47ff-4766-9d63-2660ed153427 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] HTTP exception thrown: Cannot 'detach_volume' instance c18b111d-f2de-41ac-8ae4-6738845259fb while it is in vm_state rescued Jun 27 18:50:26.901851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-5bed9da7-47ff-4766-9d63-2660ed153427 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Request method failure captured: Jun 27 18:50:26.901851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: DELETE /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb/os-volume_attachments/d66330ca-4ecf-4547-b489-87b0ed173b79 HTTP/1.1 Jun 27 18:50:26.901851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:50:26.901851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:50:26.901851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:50:26.901851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:50:26.901851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:50:26.901851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:50:26.901851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:50:26.901851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:50:26.901851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufsgqlfv0hokCGUzepT1sutv3Om-w7VtAjx5eYoTAo_0yayA7H0lYzDj9boJX55FFsz4iaATtEf3QM_KAP0BkgCG_RMrK4v_pqEJJ5CyFPTwrTDg7mKbtZ6U0_Z0If7SY0B3k10FTMIMODcd34kBHuKTGz4_2o3EkBt1a5nCDWDysYk Jun 27 18:50:26.901851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:50:26.901851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:50:26.901851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:50:26.901851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:50:26.901851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:50:26.901851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:50:26.901851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: e03ab1e3fbe7445da087c631d8af557b Jun 27 18:50:26.901851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1545486903 Jun 27 18:50:26.901851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:50:26.901851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:50:26.903464 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e03ab1e3fbe7445da087c631d8af557b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e03ab1e3fbe7445da087c631d8af557b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e03ab1e3fbe7445da087c631d8af557b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e03ab1e3fbe7445da087c631d8af557b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:50:26.903464 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1545486903 Jun 27 18:50:26.903464 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: e03ab1e3fbe7445da087c631d8af557b Jun 27 18:50:26.903464 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1545486903 Jun 27 18:50:26.903464 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-ServerRescueNegativeTestJSON-1545486903-project Jun 27 18:50:26.903464 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:50:26.903464 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:50:26.903464 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: 78b6599200a94a2a8bcc0149dc22944d Jun 27 18:50:26.903464 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1545486903-project Jun 27 18:50:26.903464 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: > Jun 27 18:50:26.903464 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Cannot 'detach_volume' instance c18b111d-f2de-41ac-8ae4-6738845259fb while it is in vm_state rescued Jun 27 18:50:26.904300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'server_id': 'c18b111d-f2de-41ac-8ae4-6738845259fb', 'id': 'd66330ca-4ecf-4547-b489-87b0ed173b79'} Jun 27 18:50:26.904300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:50:26.904300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:50:26.904300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 27 18:50:26.904300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 27 18:50:26.904300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 18:50:26.904300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 18:50:26.904300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 27 18:50:26.904300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 27 18:50:26.904300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c18b111d-f2de-41ac-8ae4-6738845259fb in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 27 18:50:26.904300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:50:26.904300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:50:26.904300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:50:26.904300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:50:26.904300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:50:26.904300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:50:26.904300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:50:26.904300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:50:26.904300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:50:26.904300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:50:26.905744 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 27 18:50:26.905744 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 27 18:50:26.905744 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 27 18:50:26.905744 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 27 18:50:26.905744 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c18b111d-f2de-41ac-8ae4-6738845259fb while it is in vm_state rescued Jun 27 18:50:26.905744 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:50:26.905744 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:50:26.905744 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:50:26.905744 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:50:26.905744 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:50:26.905744 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:50:26.905744 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:50:26.905744 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:50:26.905744 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c18b111d-f2de-41ac-8ae4-6738845259fb while it is in vm_state rescued Jun 27 18:50:26.905744 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:50:26.905744 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-5bed9da7-47ff-4766-9d63-2660ed153427 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Returning 409 to user: Cannot 'detach_volume' instance c18b111d-f2de-41ac-8ae4-6738845259fb while it is in vm_state rescued {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:50:26.907486 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-5bed9da7-47ff-4766-9d63-2660ed153427 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb/os-volume_attachments/d66330ca-4ecf-4547-b489-87b0ed173b79" status: 409 len: 152 microversion: 2.1 time: 0.100832 Jun 27 18:50:26.907783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 327/652] 10.222.0.15 () {58 vars in 1415 bytes} [Mon Jun 27 18:50:26 2022] DELETE /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb/os-volume_attachments/d66330ca-4ecf-4547-b489-87b0ed173b79 => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 27 18:50:26.911203 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-982e8876-f104-48a5-841d-d3691d6042a3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:26.912670 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-db37b2a9-8c2c-4248-9212-64b95e7c0126 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:50:26.913529 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-db37b2a9-8c2c-4248-9212-64b95e7c0126 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:26.920558 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-982e8876-f104-48a5-841d-d3691d6042a3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc" status: 200 len: 1296 microversion: 2.1 time: 0.091273 Jun 27 18:50:26.929371 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-db37b2a9-8c2c-4248-9212-64b95e7c0126 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:26.929371 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-db37b2a9-8c2c-4248-9212-64b95e7c0126 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:26.930195 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 326/653] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:26 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:50:26.930439 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-db37b2a9-8c2c-4248-9212-64b95e7c0126 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:26.930439 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-db37b2a9-8c2c-4248-9212-64b95e7c0126 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:27.087077 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-db37b2a9-8c2c-4248-9212-64b95e7c0126 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "POST /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb/action" status: 202 len: 0 microversion: 2.1 time: 0.177914 Jun 27 18:50:27.091084 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 328/654] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Jun 27 18:50:26 2022] POST /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:50:27.099663 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-21c47774-a6e9-42cf-bfe1-2d4bb3ae265f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:27.100631 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-21c47774-a6e9-42cf-bfe1-2d4bb3ae265f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:27.109259 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-21c47774-a6e9-42cf-bfe1-2d4bb3ae265f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:27.109827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-21c47774-a6e9-42cf-bfe1-2d4bb3ae265f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:27.110671 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-21c47774-a6e9-42cf-bfe1-2d4bb3ae265f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:27.111083 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-21c47774-a6e9-42cf-bfe1-2d4bb3ae265f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:27.285820 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-21c47774-a6e9-42cf-bfe1-2d4bb3ae265f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:27.296442 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-21c47774-a6e9-42cf-bfe1-2d4bb3ae265f tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1721 microversion: 2.1 time: 0.203932 Jun 27 18:50:27.308627 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 327/655] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:27 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:50:27.941471 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f2a19754-16d6-45cb-a616-b9d77c1f0349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:27.942165 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f2a19754-16d6-45cb-a616-b9d77c1f0349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:27.951255 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f2a19754-16d6-45cb-a616-b9d77c1f0349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:27.953844 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f2a19754-16d6-45cb-a616-b9d77c1f0349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:27.953844 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f2a19754-16d6-45cb-a616-b9d77c1f0349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:27.953844 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f2a19754-16d6-45cb-a616-b9d77c1f0349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:28.070375 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-7cb24117-4c75-49fd-bf31-80e708f3c0cc req-501edfe3-ca72-42d3-851e-fc785177474a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47f70d2d-989d-4644-89db-b4b37d5f07cc", "tag": "d9223b96-8c39-4c3a-a80d-f66b6e2f7c0c"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:50:28.085071 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-7cb24117-4c75-49fd-bf31-80e708f3c0cc req-501edfe3-ca72-42d3-851e-fc785177474a service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:28.086960 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-7cb24117-4c75-49fd-bf31-80e708f3c0cc req-501edfe3-ca72-42d3-851e-fc785177474a service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:28.100509 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-7cb24117-4c75-49fd-bf31-80e708f3c0cc req-501edfe3-ca72-42d3-851e-fc785177474a service nova] Creating event network-changed:d9223b96-8c39-4c3a-a80d-f66b6e2f7c0c for instance 47f70d2d-989d-4644-89db-b4b37d5f07cc on hv-cinder-84460 Jun 27 18:50:28.106986 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-7cb24117-4c75-49fd-bf31-80e708f3c0cc req-501edfe3-ca72-42d3-851e-fc785177474a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042353 Jun 27 18:50:28.107866 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 328/656] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:50:28.158416 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f2a19754-16d6-45cb-a616-b9d77c1f0349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:28.167225 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f2a19754-16d6-45cb-a616-b9d77c1f0349 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc" status: 200 len: 1364 microversion: 2.1 time: 0.229922 Jun 27 18:50:28.167808 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 329/657] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:27 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:28.315269 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-31c30ccb-e1ba-4020-b26b-d5e71d07a77d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:28.315955 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-31c30ccb-e1ba-4020-b26b-d5e71d07a77d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:28.323090 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-31c30ccb-e1ba-4020-b26b-d5e71d07a77d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:28.323473 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-31c30ccb-e1ba-4020-b26b-d5e71d07a77d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:28.324278 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-31c30ccb-e1ba-4020-b26b-d5e71d07a77d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:28.324723 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-31c30ccb-e1ba-4020-b26b-d5e71d07a77d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:28.456831 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-31c30ccb-e1ba-4020-b26b-d5e71d07a77d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:28.465542 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-31c30ccb-e1ba-4020-b26b-d5e71d07a77d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1721 microversion: 2.1 time: 0.154660 Jun 27 18:50:28.466117 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 329/658] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:28 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:29.185477 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-bb1410c4-b910-4732-9727-6808e062cd8f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:29.186090 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-bb1410c4-b910-4732-9727-6808e062cd8f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:29.188544 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:29.193399 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bb1410c4-b910-4732-9727-6808e062cd8f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:29.193844 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bb1410c4-b910-4732-9727-6808e062cd8f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:29.194626 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bb1410c4-b910-4732-9727-6808e062cd8f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:29.195058 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bb1410c4-b910-4732-9727-6808e062cd8f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:29.483603 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-b463e0df-c9f9-44fc-9cd8-3ce4d75eb6fb tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:29.484237 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-b463e0df-c9f9-44fc-9cd8-3ce4d75eb6fb tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:29.491846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b463e0df-c9f9-44fc-9cd8-3ce4d75eb6fb tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:29.492403 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b463e0df-c9f9-44fc-9cd8-3ce4d75eb6fb tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:29.493283 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b463e0df-c9f9-44fc-9cd8-3ce4d75eb6fb tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:29.493796 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b463e0df-c9f9-44fc-9cd8-3ce4d75eb6fb tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:29.618885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-bb1410c4-b910-4732-9727-6808e062cd8f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:29.627837 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-bb1410c4-b910-4732-9727-6808e062cd8f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc" status: 200 len: 1364 microversion: 2.1 time: 0.447495 Jun 27 18:50:29.637587 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 330/659] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:29 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc => generated 1364 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:29.687043 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-b463e0df-c9f9-44fc-9cd8-3ce4d75eb6fb tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:29.697212 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-b463e0df-c9f9-44fc-9cd8-3ce4d75eb6fb tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1721 microversion: 2.1 time: 0.218220 Jun 27 18:50:29.698279 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 330/660] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:29 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:50:30.644729 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-57120f72-0fc6-47c5-bf41-e51d321ddf23 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:30.645338 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-57120f72-0fc6-47c5-bf41-e51d321ddf23 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:30.652454 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-57120f72-0fc6-47c5-bf41-e51d321ddf23 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:30.652900 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-57120f72-0fc6-47c5-bf41-e51d321ddf23 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:30.653653 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-57120f72-0fc6-47c5-bf41-e51d321ddf23 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:30.654084 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-57120f72-0fc6-47c5-bf41-e51d321ddf23 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:30.715063 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e0651903-1fc2-429f-ac22-1daa4d963326 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:30.715671 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e0651903-1fc2-429f-ac22-1daa4d963326 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:30.722081 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e0651903-1fc2-429f-ac22-1daa4d963326 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:30.722572 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e0651903-1fc2-429f-ac22-1daa4d963326 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:30.723339 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e0651903-1fc2-429f-ac22-1daa4d963326 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:30.723780 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e0651903-1fc2-429f-ac22-1daa4d963326 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:30.827361 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-57120f72-0fc6-47c5-bf41-e51d321ddf23 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:30.834845 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-57120f72-0fc6-47c5-bf41-e51d321ddf23 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc" status: 200 len: 1364 microversion: 2.1 time: 0.193859 Jun 27 18:50:30.835413 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 331/661] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:30 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:30.873512 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-e0651903-1fc2-429f-ac22-1daa4d963326 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:30.882062 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e0651903-1fc2-429f-ac22-1daa4d963326 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1727 microversion: 2.1 time: 0.171032 Jun 27 18:50:30.882665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 331/662] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:30 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:50:30.898918 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f1e9799b-5ec6-41a7-a90a-838237df1129 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:30.899529 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f1e9799b-5ec6-41a7-a90a-838237df1129 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:30.905475 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f1e9799b-5ec6-41a7-a90a-838237df1129 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:30.905920 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f1e9799b-5ec6-41a7-a90a-838237df1129 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:30.906704 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f1e9799b-5ec6-41a7-a90a-838237df1129 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:30.907136 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f1e9799b-5ec6-41a7-a90a-838237df1129 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:30.984421 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f1e9799b-5ec6-41a7-a90a-838237df1129 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089323 Jun 27 18:50:30.985009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 332/663] 10.222.0.15 () {58 vars in 1274 bytes} [Mon Jun 27 18:50:30 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:50:31.852399 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-269618fd-7899-4ec7-814c-854c9fd800e3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:31.853022 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-269618fd-7899-4ec7-814c-854c9fd800e3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:31.862054 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-269618fd-7899-4ec7-814c-854c9fd800e3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:31.862054 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-269618fd-7899-4ec7-814c-854c9fd800e3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:31.862849 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-269618fd-7899-4ec7-814c-854c9fd800e3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:31.863301 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-269618fd-7899-4ec7-814c-854c9fd800e3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:31.903774 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-6b4450f3-038e-408a-a20a-acf782d3943d req-e04d0227-eeb4-485f-962b-9baba8b716c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c18b111d-f2de-41ac-8ae4-6738845259fb", "tag": "e7f919f9-9aa0-4ce8-a9d5-eaf1aec06292"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:50:31.922045 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-6b4450f3-038e-408a-a20a-acf782d3943d req-e04d0227-eeb4-485f-962b-9baba8b716c7 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:31.922806 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-6b4450f3-038e-408a-a20a-acf782d3943d req-e04d0227-eeb4-485f-962b-9baba8b716c7 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:31.935533 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-6b4450f3-038e-408a-a20a-acf782d3943d req-e04d0227-eeb4-485f-962b-9baba8b716c7 service nova] Creating event network-changed:e7f919f9-9aa0-4ce8-a9d5-eaf1aec06292 for instance c18b111d-f2de-41ac-8ae4-6738845259fb on hv-cinder-84460 Jun 27 18:50:31.940710 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-6b4450f3-038e-408a-a20a-acf782d3943d req-e04d0227-eeb4-485f-962b-9baba8b716c7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041780 Jun 27 18:50:31.941306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 333/664] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:50:32.039621 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-269618fd-7899-4ec7-814c-854c9fd800e3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:32.048193 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-269618fd-7899-4ec7-814c-854c9fd800e3 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc" status: 200 len: 1364 microversion: 2.1 time: 0.199573 Jun 27 18:50:32.048914 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 332/665] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:31 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:33.066223 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-efdc26cd-eff8-4282-afca-80267adc64df tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:33.066976 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-efdc26cd-eff8-4282-afca-80267adc64df tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:33.073131 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-efdc26cd-eff8-4282-afca-80267adc64df tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:33.073586 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-efdc26cd-eff8-4282-afca-80267adc64df tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:33.075022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-efdc26cd-eff8-4282-afca-80267adc64df tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:33.075458 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-efdc26cd-eff8-4282-afca-80267adc64df tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:33.207259 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-efdc26cd-eff8-4282-afca-80267adc64df tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:33.214496 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-efdc26cd-eff8-4282-afca-80267adc64df tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc" status: 200 len: 1364 microversion: 2.1 time: 0.153043 Jun 27 18:50:33.215053 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 334/666] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:33 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:33.957161 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell0:SELECT=2 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:33.957893 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell0:SELECT=6 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:34.017814 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-5127a77f-4632-4a0e-b9df-0482a5bc81d5 req-ea37c211-fb95-4a40-b550-fc487364f26d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c18b111d-f2de-41ac-8ae4-6738845259fb", "tag": "e7f919f9-9aa0-4ce8-a9d5-eaf1aec06292"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:50:34.026048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-5127a77f-4632-4a0e-b9df-0482a5bc81d5 req-ea37c211-fb95-4a40-b550-fc487364f26d service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:34.027214 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-5127a77f-4632-4a0e-b9df-0482a5bc81d5 req-ea37c211-fb95-4a40-b550-fc487364f26d service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:34.039098 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-5127a77f-4632-4a0e-b9df-0482a5bc81d5 req-ea37c211-fb95-4a40-b550-fc487364f26d service nova] Creating event network-changed:e7f919f9-9aa0-4ce8-a9d5-eaf1aec06292 for instance c18b111d-f2de-41ac-8ae4-6738845259fb on hv-cinder-84460 Jun 27 18:50:34.044140 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-5127a77f-4632-4a0e-b9df-0482a5bc81d5 req-ea37c211-fb95-4a40-b550-fc487364f26d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091902 Jun 27 18:50:34.045007 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 333/667] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:50:34.231492 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-45d623fd-48df-4b9e-a08d-615635b3bea2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:34.232645 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-45d623fd-48df-4b9e-a08d-615635b3bea2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:34.234735 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=6 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:34.240287 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-45d623fd-48df-4b9e-a08d-615635b3bea2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:34.240958 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-45d623fd-48df-4b9e-a08d-615635b3bea2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:34.241741 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-45d623fd-48df-4b9e-a08d-615635b3bea2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:34.242185 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-45d623fd-48df-4b9e-a08d-615635b3bea2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:34.459812 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-45d623fd-48df-4b9e-a08d-615635b3bea2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:34.468306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-45d623fd-48df-4b9e-a08d-615635b3bea2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc" status: 200 len: 1364 microversion: 2.1 time: 0.240723 Jun 27 18:50:34.469053 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 335/668] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:34 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:35.487306 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-d1f6f291-2cfd-41e2-8486-febb2ae75460 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:35.488054 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-d1f6f291-2cfd-41e2-8486-febb2ae75460 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:35.495721 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d1f6f291-2cfd-41e2-8486-febb2ae75460 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:35.496413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d1f6f291-2cfd-41e2-8486-febb2ae75460 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:35.497473 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d1f6f291-2cfd-41e2-8486-febb2ae75460 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:35.498739 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d1f6f291-2cfd-41e2-8486-febb2ae75460 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:35.582374 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-63ad7cc6-388f-47d4-b595-58b43c381bc4 req-43824eeb-db1c-43cc-8222-50dd243c8a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47f70d2d-989d-4644-89db-b4b37d5f07cc", "name": "network-vif-plugged", "status": "completed", "tag": "d9223b96-8c39-4c3a-a80d-f66b6e2f7c0c"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:50:35.591775 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-63ad7cc6-388f-47d4-b595-58b43c381bc4 req-43824eeb-db1c-43cc-8222-50dd243c8a45 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:35.592557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-63ad7cc6-388f-47d4-b595-58b43c381bc4 req-43824eeb-db1c-43cc-8222-50dd243c8a45 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:35.604570 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-63ad7cc6-388f-47d4-b595-58b43c381bc4 req-43824eeb-db1c-43cc-8222-50dd243c8a45 service nova] Creating event network-vif-plugged:d9223b96-8c39-4c3a-a80d-f66b6e2f7c0c for instance 47f70d2d-989d-4644-89db-b4b37d5f07cc on hv-cinder-84460 Jun 27 18:50:35.610340 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-63ad7cc6-388f-47d4-b595-58b43c381bc4 req-43824eeb-db1c-43cc-8222-50dd243c8a45 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031979 Jun 27 18:50:35.611270 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 336/669] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:50:35.645642 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-d1f6f291-2cfd-41e2-8486-febb2ae75460 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:35.653433 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-d1f6f291-2cfd-41e2-8486-febb2ae75460 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc" status: 200 len: 1364 microversion: 2.1 time: 0.171874 Jun 27 18:50:35.654194 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 334/670] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:35 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:36.671329 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-3e8387df-5eb8-4c89-9c5b-553d8b16e1e5 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:36.672234 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-3e8387df-5eb8-4c89-9c5b-553d8b16e1e5 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:36.679102 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3e8387df-5eb8-4c89-9c5b-553d8b16e1e5 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:36.679694 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3e8387df-5eb8-4c89-9c5b-553d8b16e1e5 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:36.680507 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3e8387df-5eb8-4c89-9c5b-553d8b16e1e5 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:36.681017 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3e8387df-5eb8-4c89-9c5b-553d8b16e1e5 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:36.817668 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3e8387df-5eb8-4c89-9c5b-553d8b16e1e5 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:36.825039 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-3e8387df-5eb8-4c89-9c5b-553d8b16e1e5 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc" status: 200 len: 1364 microversion: 2.1 time: 0.158624 Jun 27 18:50:36.826419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 337/671] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:36 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:37.842640 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-b41dc69f-5cdc-49a8-bb24-e74157cc3568 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:37.843975 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-b41dc69f-5cdc-49a8-bb24-e74157cc3568 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:37.850677 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b41dc69f-5cdc-49a8-bb24-e74157cc3568 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:37.851482 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b41dc69f-5cdc-49a8-bb24-e74157cc3568 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:37.851939 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b41dc69f-5cdc-49a8-bb24-e74157cc3568 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:37.852384 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b41dc69f-5cdc-49a8-bb24-e74157cc3568 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:37.983137 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-b41dc69f-5cdc-49a8-bb24-e74157cc3568 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:37.991562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-b41dc69f-5cdc-49a8-bb24-e74157cc3568 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc" status: 200 len: 1549 microversion: 2.1 time: 0.153024 Jun 27 18:50:37.992130 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 335/672] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:50:37 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:50:38.008307 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-87955f34-7724-4e49-b6c5-133fb265469b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:38.008815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-87955f34-7724-4e49-b6c5-133fb265469b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:38.015970 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-87955f34-7724-4e49-b6c5-133fb265469b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:38.016421 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-87955f34-7724-4e49-b6c5-133fb265469b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:38.017184 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-87955f34-7724-4e49-b6c5-133fb265469b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:38.017623 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-87955f34-7724-4e49-b6c5-133fb265469b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:38.094562 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-87955f34-7724-4e49-b6c5-133fb265469b tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090183 Jun 27 18:50:38.095160 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 338/673] 10.222.0.15 () {58 vars in 1274 bytes} [Mon Jun 27 18:50:38 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:50:39.220135 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-ee11717c-5ad1-4569-96f6-9ca98b8aad54 req-9e5444db-5907-422f-b9c3-b28bcf88ef41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47f70d2d-989d-4644-89db-b4b37d5f07cc", "tag": "d9223b96-8c39-4c3a-a80d-f66b6e2f7c0c"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:50:39.228465 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-ee11717c-5ad1-4569-96f6-9ca98b8aad54 req-9e5444db-5907-422f-b9c3-b28bcf88ef41 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:39.229171 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-ee11717c-5ad1-4569-96f6-9ca98b8aad54 req-9e5444db-5907-422f-b9c3-b28bcf88ef41 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:39.241599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-ee11717c-5ad1-4569-96f6-9ca98b8aad54 req-9e5444db-5907-422f-b9c3-b28bcf88ef41 service nova] Creating event network-changed:d9223b96-8c39-4c3a-a80d-f66b6e2f7c0c for instance 47f70d2d-989d-4644-89db-b4b37d5f07cc on hv-cinder-84460 Jun 27 18:50:39.246653 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-ee11717c-5ad1-4569-96f6-9ca98b8aad54 req-9e5444db-5907-422f-b9c3-b28bcf88ef41 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207658 Jun 27 18:50:39.251881 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 336/674] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:50:39.584848 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-1e3b3557-e3e7-4a6d-90c8-6970f84f148f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:39.585979 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-1e3b3557-e3e7-4a6d-90c8-6970f84f148f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:39.592585 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1e3b3557-e3e7-4a6d-90c8-6970f84f148f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:39.593545 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1e3b3557-e3e7-4a6d-90c8-6970f84f148f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:39.594529 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1e3b3557-e3e7-4a6d-90c8-6970f84f148f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:39.595132 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1e3b3557-e3e7-4a6d-90c8-6970f84f148f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:39.616035 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:39.623698 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-1e3b3557-e3e7-4a6d-90c8-6970f84f148f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b/ips" status: 200 len: 151 microversion: 2.20 time: 0.182004 Jun 27 18:50:39.640417 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 339/675] 10.222.0.15 () {60 vars in 1288 bytes} [Mon Jun 27 18:50:39 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b/ips => generated 151 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 18:50:41.681262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-6c37ff95-75bd-435d-892c-309e5d12b97a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:50:41.681919 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-6c37ff95-75bd-435d-892c-309e5d12b97a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:41.688729 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6c37ff95-75bd-435d-892c-309e5d12b97a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:41.689180 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6c37ff95-75bd-435d-892c-309e5d12b97a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:41.689952 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6c37ff95-75bd-435d-892c-309e5d12b97a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:41.690888 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6c37ff95-75bd-435d-892c-309e5d12b97a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:41.712612 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.objects.instance [None req-6c37ff95-75bd-435d-892c-309e5d12b97a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lazy-loading 'flavor' on Instance uuid 3ed77686-7baf-499a-9104-4bfe284ad76b {{(pid=124717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:50:41.813940 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:42.249082 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-6c37ff95-75bd-435d-892c-309e5d12b97a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "POST /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b/action" status: 202 len: 0 microversion: 2.20 time: 0.572052 Jun 27 18:50:42.249904 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 337/676] 10.222.0.15 () {62 vars in 1318 bytes} [Mon Jun 27 18:50:41 2022] POST /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b/action => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 18:50:42.258514 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-94b0c943-fbac-4bd7-9cef-3d12adbdc899 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:42.259187 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-94b0c943-fbac-4bd7-9cef-3d12adbdc899 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:42.266422 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-94b0c943-fbac-4bd7-9cef-3d12adbdc899 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:42.281278 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-94b0c943-fbac-4bd7-9cef-3d12adbdc899 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:42.281278 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-94b0c943-fbac-4bd7-9cef-3d12adbdc899 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:42.281278 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-94b0c943-fbac-4bd7-9cef-3d12adbdc899 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:42.400051 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-94b0c943-fbac-4bd7-9cef-3d12adbdc899 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:42.408346 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-94b0c943-fbac-4bd7-9cef-3d12adbdc899 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:42.409857 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-94b0c943-fbac-4bd7-9cef-3d12adbdc899 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:42.411037 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-94b0c943-fbac-4bd7-9cef-3d12adbdc899 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1720 microversion: 2.20 time: 0.156810 Jun 27 18:50:42.411592 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 340/677] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:50:42 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:50:43.430756 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-f6da31e9-d4bd-4604-9afd-b48eb22b052f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:43.431501 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-f6da31e9-d4bd-4604-9afd-b48eb22b052f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:43.438369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f6da31e9-d4bd-4604-9afd-b48eb22b052f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:43.438843 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f6da31e9-d4bd-4604-9afd-b48eb22b052f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:43.439604 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f6da31e9-d4bd-4604-9afd-b48eb22b052f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:43.440044 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f6da31e9-d4bd-4604-9afd-b48eb22b052f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:43.569136 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-f6da31e9-d4bd-4604-9afd-b48eb22b052f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:43.577292 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-f6da31e9-d4bd-4604-9afd-b48eb22b052f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:43.578880 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-f6da31e9-d4bd-4604-9afd-b48eb22b052f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:43.580059 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-f6da31e9-d4bd-4604-9afd-b48eb22b052f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1720 microversion: 2.20 time: 0.154126 Jun 27 18:50:43.580619 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 338/678] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:50:43 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:50:44.598646 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-5e1e8394-dfa9-4ed4-99d6-2859c7abcba7 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:44.599263 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-5e1e8394-dfa9-4ed4-99d6-2859c7abcba7 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:44.605770 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5e1e8394-dfa9-4ed4-99d6-2859c7abcba7 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:44.606220 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5e1e8394-dfa9-4ed4-99d6-2859c7abcba7 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:44.607016 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5e1e8394-dfa9-4ed4-99d6-2859c7abcba7 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:44.607454 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5e1e8394-dfa9-4ed4-99d6-2859c7abcba7 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:44.741118 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-5e1e8394-dfa9-4ed4-99d6-2859c7abcba7 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:44.749079 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-5e1e8394-dfa9-4ed4-99d6-2859c7abcba7 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:44.751554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-5e1e8394-dfa9-4ed4-99d6-2859c7abcba7 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:44.752723 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-5e1e8394-dfa9-4ed4-99d6-2859c7abcba7 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1720 microversion: 2.20 time: 0.158089 Jun 27 18:50:44.753282 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 341/679] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:50:44 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:50:45.770942 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-75ec132c-bdc9-42cb-9900-7f0e5fa3f488 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:45.771558 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-75ec132c-bdc9-42cb-9900-7f0e5fa3f488 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:45.777761 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-75ec132c-bdc9-42cb-9900-7f0e5fa3f488 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:45.778212 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-75ec132c-bdc9-42cb-9900-7f0e5fa3f488 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:45.779030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-75ec132c-bdc9-42cb-9900-7f0e5fa3f488 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:45.779460 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-75ec132c-bdc9-42cb-9900-7f0e5fa3f488 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:45.905291 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-75ec132c-bdc9-42cb-9900-7f0e5fa3f488 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:45.913553 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-75ec132c-bdc9-42cb-9900-7f0e5fa3f488 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:45.915108 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-75ec132c-bdc9-42cb-9900-7f0e5fa3f488 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:45.916261 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-75ec132c-bdc9-42cb-9900-7f0e5fa3f488 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1720 microversion: 2.20 time: 0.149260 Jun 27 18:50:45.916844 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 339/680] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:50:45 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:50:46.935050 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-d81f3100-879f-43f5-8b5e-d64d2271b4b4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:46.935689 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-d81f3100-879f-43f5-8b5e-d64d2271b4b4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:46.942277 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d81f3100-879f-43f5-8b5e-d64d2271b4b4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:46.942754 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d81f3100-879f-43f5-8b5e-d64d2271b4b4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:46.943561 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d81f3100-879f-43f5-8b5e-d64d2271b4b4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:46.944000 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d81f3100-879f-43f5-8b5e-d64d2271b4b4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:47.070771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-d81f3100-879f-43f5-8b5e-d64d2271b4b4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:47.079106 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-d81f3100-879f-43f5-8b5e-d64d2271b4b4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:47.080627 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-d81f3100-879f-43f5-8b5e-d64d2271b4b4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:47.081793 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-d81f3100-879f-43f5-8b5e-d64d2271b4b4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1720 microversion: 2.20 time: 0.150699 Jun 27 18:50:47.082355 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 342/681] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:50:46 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:50:48.099655 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-4dd31ab2-6307-4a8c-9423-118eb751e485 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:48.100267 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-4dd31ab2-6307-4a8c-9423-118eb751e485 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:48.106725 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4dd31ab2-6307-4a8c-9423-118eb751e485 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:48.107165 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4dd31ab2-6307-4a8c-9423-118eb751e485 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:48.107919 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4dd31ab2-6307-4a8c-9423-118eb751e485 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:48.108352 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4dd31ab2-6307-4a8c-9423-118eb751e485 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:48.240536 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-4dd31ab2-6307-4a8c-9423-118eb751e485 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:48.248252 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-4dd31ab2-6307-4a8c-9423-118eb751e485 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:48.250242 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-4dd31ab2-6307-4a8c-9423-118eb751e485 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:48.251443 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-4dd31ab2-6307-4a8c-9423-118eb751e485 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1720 microversion: 2.20 time: 0.155664 Jun 27 18:50:48.252004 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 340/682] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:50:48 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:50:49.269808 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-df22a38a-b55d-45e1-8573-f77a75e4cc83 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:49.273160 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-df22a38a-b55d-45e1-8573-f77a75e4cc83 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:49.276567 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-df22a38a-b55d-45e1-8573-f77a75e4cc83 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:49.277013 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-df22a38a-b55d-45e1-8573-f77a75e4cc83 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:49.277773 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-df22a38a-b55d-45e1-8573-f77a75e4cc83 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:49.278205 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-df22a38a-b55d-45e1-8573-f77a75e4cc83 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:49.407344 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-df22a38a-b55d-45e1-8573-f77a75e4cc83 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:49.415091 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-df22a38a-b55d-45e1-8573-f77a75e4cc83 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:49.416601 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-df22a38a-b55d-45e1-8573-f77a75e4cc83 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:49.417791 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-df22a38a-b55d-45e1-8573-f77a75e4cc83 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1720 microversion: 2.20 time: 0.152509 Jun 27 18:50:49.418603 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 343/683] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:50:49 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:50:50.436565 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e273cee9-5fd0-44c4-b296-9fd84d7601ab tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:50.437718 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e273cee9-5fd0-44c4-b296-9fd84d7601ab tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:50.444284 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e273cee9-5fd0-44c4-b296-9fd84d7601ab tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:50.444734 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e273cee9-5fd0-44c4-b296-9fd84d7601ab tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:50.445531 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e273cee9-5fd0-44c4-b296-9fd84d7601ab tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:50.446001 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e273cee9-5fd0-44c4-b296-9fd84d7601ab tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:50.577492 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-e273cee9-5fd0-44c4-b296-9fd84d7601ab tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:50.585591 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-e273cee9-5fd0-44c4-b296-9fd84d7601ab tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:50.587118 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-e273cee9-5fd0-44c4-b296-9fd84d7601ab tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:50.588280 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e273cee9-5fd0-44c4-b296-9fd84d7601ab tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1720 microversion: 2.20 time: 0.155732 Jun 27 18:50:50.588858 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 341/684] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:50:50 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:50:51.606689 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-b2d199ff-cb47-4fc0-bafe-87907aa59a57 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:51.607310 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-b2d199ff-cb47-4fc0-bafe-87907aa59a57 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:51.614894 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b2d199ff-cb47-4fc0-bafe-87907aa59a57 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:51.615345 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b2d199ff-cb47-4fc0-bafe-87907aa59a57 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:51.616106 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b2d199ff-cb47-4fc0-bafe-87907aa59a57 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:51.616542 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b2d199ff-cb47-4fc0-bafe-87907aa59a57 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:51.744996 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-b2d199ff-cb47-4fc0-bafe-87907aa59a57 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:51.752885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-b2d199ff-cb47-4fc0-bafe-87907aa59a57 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:51.754412 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-b2d199ff-cb47-4fc0-bafe-87907aa59a57 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:51.755593 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-b2d199ff-cb47-4fc0-bafe-87907aa59a57 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1720 microversion: 2.20 time: 0.152922 Jun 27 18:50:51.756130 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 344/685] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:50:51 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:50:52.774398 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-6d40ac9a-4b44-48b4-ac4a-ab4ef5aa0586 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:52.775011 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-6d40ac9a-4b44-48b4-ac4a-ab4ef5aa0586 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:52.782198 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6d40ac9a-4b44-48b4-ac4a-ab4ef5aa0586 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:52.782659 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6d40ac9a-4b44-48b4-ac4a-ab4ef5aa0586 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:52.783414 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6d40ac9a-4b44-48b4-ac4a-ab4ef5aa0586 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:52.783915 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6d40ac9a-4b44-48b4-ac4a-ab4ef5aa0586 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:52.916175 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-6d40ac9a-4b44-48b4-ac4a-ab4ef5aa0586 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:52.924501 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-6d40ac9a-4b44-48b4-ac4a-ab4ef5aa0586 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:52.926004 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-6d40ac9a-4b44-48b4-ac4a-ab4ef5aa0586 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:52.927209 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-6d40ac9a-4b44-48b4-ac4a-ab4ef5aa0586 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1741 microversion: 2.20 time: 0.156924 Jun 27 18:50:52.927769 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 342/686] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:50:52 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1741 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:50:53.946006 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f95ab74a-55fc-4fe9-a78c-33d34686ae6c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:53.957376 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f95ab74a-55fc-4fe9-a78c-33d34686ae6c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:53.957376 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f95ab74a-55fc-4fe9-a78c-33d34686ae6c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:53.957376 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f95ab74a-55fc-4fe9-a78c-33d34686ae6c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:53.957376 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f95ab74a-55fc-4fe9-a78c-33d34686ae6c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:53.957806 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f95ab74a-55fc-4fe9-a78c-33d34686ae6c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:54.083176 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f95ab74a-55fc-4fe9-a78c-33d34686ae6c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:54.091117 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f95ab74a-55fc-4fe9-a78c-33d34686ae6c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:54.092626 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f95ab74a-55fc-4fe9-a78c-33d34686ae6c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:54.093804 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f95ab74a-55fc-4fe9-a78c-33d34686ae6c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1741 microversion: 2.20 time: 0.151757 Jun 27 18:50:54.094368 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 345/687] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:50:53 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1741 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:50:55.112605 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a1371951-f01d-4ec1-9e7e-d0989ce99121 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:55.113550 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-a1371951-f01d-4ec1-9e7e-d0989ce99121 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:55.119975 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a1371951-f01d-4ec1-9e7e-d0989ce99121 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:55.120420 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a1371951-f01d-4ec1-9e7e-d0989ce99121 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:55.121170 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a1371951-f01d-4ec1-9e7e-d0989ce99121 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:55.121603 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a1371951-f01d-4ec1-9e7e-d0989ce99121 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:55.248852 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a1371951-f01d-4ec1-9e7e-d0989ce99121 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:55.257512 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a1371951-f01d-4ec1-9e7e-d0989ce99121 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:55.259065 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a1371951-f01d-4ec1-9e7e-d0989ce99121 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:55.260235 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-a1371951-f01d-4ec1-9e7e-d0989ce99121 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1741 microversion: 2.20 time: 0.152082 Jun 27 18:50:55.260793 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 343/688] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:50:55 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1741 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:50:56.279583 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-bba2331b-c1d3-4824-99ce-412b26ed2e6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:56.281520 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-bba2331b-c1d3-4824-99ce-412b26ed2e6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:56.288798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bba2331b-c1d3-4824-99ce-412b26ed2e6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:56.289482 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bba2331b-c1d3-4824-99ce-412b26ed2e6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:56.290519 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bba2331b-c1d3-4824-99ce-412b26ed2e6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:56.291256 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bba2331b-c1d3-4824-99ce-412b26ed2e6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:56.449310 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-bba2331b-c1d3-4824-99ce-412b26ed2e6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:56.460332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-bba2331b-c1d3-4824-99ce-412b26ed2e6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:56.462173 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-bba2331b-c1d3-4824-99ce-412b26ed2e6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:56.463388 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-bba2331b-c1d3-4824-99ce-412b26ed2e6a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1736 microversion: 2.20 time: 0.188165 Jun 27 18:50:56.464418 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 346/689] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:50:56 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:50:57.484889 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a15f3230-8036-4859-a7ff-5732cfb61511 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:57.485433 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-a15f3230-8036-4859-a7ff-5732cfb61511 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:57.491821 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_api:SELECT=38 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:57.493289 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a15f3230-8036-4859-a7ff-5732cfb61511 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:57.493983 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a15f3230-8036-4859-a7ff-5732cfb61511 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:57.495005 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a15f3230-8036-4859-a7ff-5732cfb61511 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:57.495639 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a15f3230-8036-4859-a7ff-5732cfb61511 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:57.615635 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-51056983-0454-4551-9dff-00a360ae29a1 req-e80efda4-8f22-4365-921b-292fec622771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed77686-7baf-499a-9104-4bfe284ad76b", "name": "network-vif-plugged", "status": "completed", "tag": "c771ad0c-04e1-4dea-b13c-fbcf24ecd5ac"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:50:57.630749 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-51056983-0454-4551-9dff-00a360ae29a1 req-e80efda4-8f22-4365-921b-292fec622771 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:57.635793 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-51056983-0454-4551-9dff-00a360ae29a1 req-e80efda4-8f22-4365-921b-292fec622771 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:57.651553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-51056983-0454-4551-9dff-00a360ae29a1 req-e80efda4-8f22-4365-921b-292fec622771 service nova] Creating event network-vif-plugged:c771ad0c-04e1-4dea-b13c-fbcf24ecd5ac for instance 3ed77686-7baf-499a-9104-4bfe284ad76b on hv-cinder-84460 Jun 27 18:50:57.657608 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-51056983-0454-4551-9dff-00a360ae29a1 req-e80efda4-8f22-4365-921b-292fec622771 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045283 Jun 27 18:50:57.662425 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 347/690] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:50:57.676650 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a15f3230-8036-4859-a7ff-5732cfb61511 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:57.686508 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a15f3230-8036-4859-a7ff-5732cfb61511 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:57.689311 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a15f3230-8036-4859-a7ff-5732cfb61511 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:57.690845 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-a15f3230-8036-4859-a7ff-5732cfb61511 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1736 microversion: 2.20 time: 0.212703 Jun 27 18:50:57.691668 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 344/691] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:50:57 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:50:58.711572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-ff68840d-1852-4df5-a00e-69e38c20ba21 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:58.712268 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-ff68840d-1852-4df5-a00e-69e38c20ba21 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:58.719522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ff68840d-1852-4df5-a00e-69e38c20ba21 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:58.720086 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ff68840d-1852-4df5-a00e-69e38c20ba21 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:58.720853 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ff68840d-1852-4df5-a00e-69e38c20ba21 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:58.721311 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ff68840d-1852-4df5-a00e-69e38c20ba21 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:58.871214 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-ff68840d-1852-4df5-a00e-69e38c20ba21 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:58.879746 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-ff68840d-1852-4df5-a00e-69e38c20ba21 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:58.881315 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-ff68840d-1852-4df5-a00e-69e38c20ba21 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:50:58.882514 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-ff68840d-1852-4df5-a00e-69e38c20ba21 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1736 microversion: 2.20 time: 0.175800 Jun 27 18:50:58.883079 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 348/692] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:50:58 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:50:59.900739 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-eaf4479d-1148-4d22-ab57-fad1be17d597 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:50:59.901350 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-eaf4479d-1148-4d22-ab57-fad1be17d597 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:50:59.908727 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-eaf4479d-1148-4d22-ab57-fad1be17d597 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:59.909180 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-eaf4479d-1148-4d22-ab57-fad1be17d597 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:50:59.909952 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-eaf4479d-1148-4d22-ab57-fad1be17d597 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:50:59.910594 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-eaf4479d-1148-4d22-ab57-fad1be17d597 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:00.065765 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-eaf4479d-1148-4d22-ab57-fad1be17d597 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:00.074211 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-eaf4479d-1148-4d22-ab57-fad1be17d597 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:00.076110 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-eaf4479d-1148-4d22-ab57-fad1be17d597 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:00.077672 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-eaf4479d-1148-4d22-ab57-fad1be17d597 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1736 microversion: 2.20 time: 0.180689 Jun 27 18:51:00.082708 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 345/693] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:50:59 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:51:01.099994 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-770f0c62-4205-4b83-80de-c8de55f05873 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:01.099994 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-770f0c62-4205-4b83-80de-c8de55f05873 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:01.100801 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_api:SELECT=38 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:01.106105 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-770f0c62-4205-4b83-80de-c8de55f05873 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:01.106743 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-770f0c62-4205-4b83-80de-c8de55f05873 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:01.107526 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-770f0c62-4205-4b83-80de-c8de55f05873 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:01.108100 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-770f0c62-4205-4b83-80de-c8de55f05873 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:01.253804 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-770f0c62-4205-4b83-80de-c8de55f05873 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:01.262664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-770f0c62-4205-4b83-80de-c8de55f05873 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:01.264208 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-770f0c62-4205-4b83-80de-c8de55f05873 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:01.266058 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-770f0c62-4205-4b83-80de-c8de55f05873 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1736 microversion: 2.20 time: 0.172518 Jun 27 18:51:01.266830 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 349/694] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:01 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:51:02.284765 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-fde92ba7-7aec-4f69-916a-394777d4734c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:02.285362 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-fde92ba7-7aec-4f69-916a-394777d4734c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:02.293852 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-fde92ba7-7aec-4f69-916a-394777d4734c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:02.294300 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-fde92ba7-7aec-4f69-916a-394777d4734c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:02.295099 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-fde92ba7-7aec-4f69-916a-394777d4734c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:02.295532 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-fde92ba7-7aec-4f69-916a-394777d4734c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:02.448115 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-fde92ba7-7aec-4f69-916a-394777d4734c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:02.459961 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-fde92ba7-7aec-4f69-916a-394777d4734c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:02.461488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-fde92ba7-7aec-4f69-916a-394777d4734c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:02.462698 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-fde92ba7-7aec-4f69-916a-394777d4734c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1736 microversion: 2.20 time: 0.182980 Jun 27 18:51:02.475985 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 346/695] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:02 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:51:03.484924 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-df77709f-c189-4fbc-b28b-25841c213244 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:03.485699 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-df77709f-c189-4fbc-b28b-25841c213244 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:03.494302 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-df77709f-c189-4fbc-b28b-25841c213244 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:03.494302 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-df77709f-c189-4fbc-b28b-25841c213244 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:03.494302 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-df77709f-c189-4fbc-b28b-25841c213244 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:03.494781 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-df77709f-c189-4fbc-b28b-25841c213244 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:03.660319 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-df77709f-c189-4fbc-b28b-25841c213244 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:03.670635 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-df77709f-c189-4fbc-b28b-25841c213244 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:03.673365 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-df77709f-c189-4fbc-b28b-25841c213244 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:03.674911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-df77709f-c189-4fbc-b28b-25841c213244 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1736 microversion: 2.20 time: 0.195105 Jun 27 18:51:03.685769 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 350/696] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:03 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:51:04.694028 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-413ac3e3-9d5d-4ab3-845a-3f8afba7020e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:04.694692 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-413ac3e3-9d5d-4ab3-845a-3f8afba7020e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:04.701450 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-413ac3e3-9d5d-4ab3-845a-3f8afba7020e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:04.701903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-413ac3e3-9d5d-4ab3-845a-3f8afba7020e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:04.702738 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-413ac3e3-9d5d-4ab3-845a-3f8afba7020e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:04.703180 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-413ac3e3-9d5d-4ab3-845a-3f8afba7020e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:04.854314 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-413ac3e3-9d5d-4ab3-845a-3f8afba7020e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:04.867521 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-413ac3e3-9d5d-4ab3-845a-3f8afba7020e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:04.868940 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-413ac3e3-9d5d-4ab3-845a-3f8afba7020e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:04.870362 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-413ac3e3-9d5d-4ab3-845a-3f8afba7020e tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1736 microversion: 2.20 time: 0.180399 Jun 27 18:51:04.870915 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 347/697] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:04 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:51:05.889087 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a0213610-8946-42fd-b02b-ec1841db5bea tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:05.889735 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a0213610-8946-42fd-b02b-ec1841db5bea tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:05.896344 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a0213610-8946-42fd-b02b-ec1841db5bea tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:05.896794 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a0213610-8946-42fd-b02b-ec1841db5bea tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:05.897558 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a0213610-8946-42fd-b02b-ec1841db5bea tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:05.897996 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a0213610-8946-42fd-b02b-ec1841db5bea tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:06.026509 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a0213610-8946-42fd-b02b-ec1841db5bea tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:06.035108 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a0213610-8946-42fd-b02b-ec1841db5bea tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:06.036601 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a0213610-8946-42fd-b02b-ec1841db5bea tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:06.037776 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a0213610-8946-42fd-b02b-ec1841db5bea tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1736 microversion: 2.20 time: 0.152725 Jun 27 18:51:06.038343 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 351/698] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:05 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:51:07.056228 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-c02fe4c1-c38b-4b44-8241-63d2ac4ac2da tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:07.056835 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-c02fe4c1-c38b-4b44-8241-63d2ac4ac2da tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:07.064569 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c02fe4c1-c38b-4b44-8241-63d2ac4ac2da tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:07.065043 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c02fe4c1-c38b-4b44-8241-63d2ac4ac2da tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:07.065796 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c02fe4c1-c38b-4b44-8241-63d2ac4ac2da tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:07.066230 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c02fe4c1-c38b-4b44-8241-63d2ac4ac2da tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:07.196331 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-c02fe4c1-c38b-4b44-8241-63d2ac4ac2da tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:07.204128 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-c02fe4c1-c38b-4b44-8241-63d2ac4ac2da tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:07.205633 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-c02fe4c1-c38b-4b44-8241-63d2ac4ac2da tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:07.206816 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-c02fe4c1-c38b-4b44-8241-63d2ac4ac2da tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1718 microversion: 2.20 time: 0.154558 Jun 27 18:51:07.207380 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 348/699] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:07 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:51:08.225839 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-3d7b440a-3b66-4797-80c8-63c4e2ca5f15 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:08.226476 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-3d7b440a-3b66-4797-80c8-63c4e2ca5f15 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:08.232934 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3d7b440a-3b66-4797-80c8-63c4e2ca5f15 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:08.233382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3d7b440a-3b66-4797-80c8-63c4e2ca5f15 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:08.234139 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3d7b440a-3b66-4797-80c8-63c4e2ca5f15 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:08.234620 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3d7b440a-3b66-4797-80c8-63c4e2ca5f15 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:08.366044 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3d7b440a-3b66-4797-80c8-63c4e2ca5f15 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:08.373852 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3d7b440a-3b66-4797-80c8-63c4e2ca5f15 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:08.375384 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3d7b440a-3b66-4797-80c8-63c4e2ca5f15 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:08.376641 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-3d7b440a-3b66-4797-80c8-63c4e2ca5f15 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1718 microversion: 2.20 time: 0.154619 Jun 27 18:51:08.377206 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 352/700] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:08 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:51:09.395197 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-50caea22-672c-4a1b-b97f-d3427927afab tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:09.395808 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-50caea22-672c-4a1b-b97f-d3427927afab tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:09.402286 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-50caea22-672c-4a1b-b97f-d3427927afab tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:09.402775 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-50caea22-672c-4a1b-b97f-d3427927afab tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:09.403527 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-50caea22-672c-4a1b-b97f-d3427927afab tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:09.403959 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-50caea22-672c-4a1b-b97f-d3427927afab tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:09.542689 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-50caea22-672c-4a1b-b97f-d3427927afab tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:09.548617 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-50caea22-672c-4a1b-b97f-d3427927afab tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:09.550137 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-50caea22-672c-4a1b-b97f-d3427927afab tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:09.551335 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-50caea22-672c-4a1b-b97f-d3427927afab tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1661 microversion: 2.20 time: 0.160076 Jun 27 18:51:09.551903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 349/701] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:09 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1661 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:51:09.570146 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-481482f7-7df1-4645-9951-844cf9a1456f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9194eb40-79cc-4c45-b499-dc25241478ff"}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:51:09.571345 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-481482f7-7df1-4645-9951-844cf9a1456f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:09.577331 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-481482f7-7df1-4645-9951-844cf9a1456f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:09.577785 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-481482f7-7df1-4645-9951-844cf9a1456f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:09.578619 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-481482f7-7df1-4645-9951-844cf9a1456f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:09.579181 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-481482f7-7df1-4645-9951-844cf9a1456f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:09.589132 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-e95f6a85-1f13-4336-a3a4-489b21b29715 req-6c7d8cce-32f1-4ab5-a47b-017c3c59d003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed77686-7baf-499a-9104-4bfe284ad76b", "name": "network-vif-unplugged", "status": "completed", "tag": "c771ad0c-04e1-4dea-b13c-fbcf24ecd5ac"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:51:09.597710 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-e95f6a85-1f13-4336-a3a4-489b21b29715 req-6c7d8cce-32f1-4ab5-a47b-017c3c59d003 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:09.598307 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-e95f6a85-1f13-4336-a3a4-489b21b29715 req-6c7d8cce-32f1-4ab5-a47b-017c3c59d003 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:09.615384 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.compute.server_external_events [req-e95f6a85-1f13-4336-a3a4-489b21b29715 req-6c7d8cce-32f1-4ab5-a47b-017c3c59d003 service nova] Unable to find a host for instance 3ed77686-7baf-499a-9104-4bfe284ad76b. Dropping event network-vif-unplugged {{(pid=124716) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 27 18:51:09.616275 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-e95f6a85-1f13-4336-a3a4-489b21b29715 req-6c7d8cce-32f1-4ab5-a47b-017c3c59d003 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.090698 Jun 27 18:51:09.616864 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 353/702] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 92 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 27 18:51:09.682635 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-8146ab95-05e6-44f8-a739-63919c60fed1 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:09.683148 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-8146ab95-05e6-44f8-a739-63919c60fed1 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:09.689974 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8146ab95-05e6-44f8-a739-63919c60fed1 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:09.690438 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8146ab95-05e6-44f8-a739-63919c60fed1 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:09.691189 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8146ab95-05e6-44f8-a739-63919c60fed1 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:09.691617 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8146ab95-05e6-44f8-a739-63919c60fed1 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:09.780703 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.objects.instance [None req-8146ab95-05e6-44f8-a739-63919c60fed1 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lazy-loading 'services' on Instance uuid c18b111d-f2de-41ac-8ae4-6738845259fb {{(pid=124716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:51:10.038070 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-8146ab95-05e6-44f8-a739-63919c60fed1 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb/os-volume_attachments/d66330ca-4ecf-4547-b489-87b0ed173b79" status: 202 len: 0 microversion: 2.1 time: 0.359180 Jun 27 18:51:10.038900 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 354/703] 10.222.0.15 () {58 vars in 1415 bytes} [Mon Jun 27 18:51:09 2022] DELETE /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb/os-volume_attachments/d66330ca-4ecf-4547-b489-87b0ed173b79 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 18:51:10.047320 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-35f79093-49ff-44b3-ab3b-bdae58433052 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:10.048884 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-35f79093-49ff-44b3-ab3b-bdae58433052 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:10.055039 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-35f79093-49ff-44b3-ab3b-bdae58433052 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:10.055486 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-35f79093-49ff-44b3-ab3b-bdae58433052 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:10.056254 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-35f79093-49ff-44b3-ab3b-bdae58433052 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:10.056688 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-35f79093-49ff-44b3-ab3b-bdae58433052 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:10.085930 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-35f79093-49ff-44b3-ab3b-bdae58433052 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042714 Jun 27 18:51:10.086505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 355/704] 10.222.0.15 () {58 vars in 1301 bytes} [Mon Jun 27 18:51:10 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:51:10.408719 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:SELECT=91,nova_cell1:INSERT=4 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:10.505576 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-481482f7-7df1-4645-9951-844cf9a1456f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "POST /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.939336 Jun 27 18:51:10.506135 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 350/705] 10.222.0.15 () {62 vars in 1363 bytes} [Mon Jun 27 18:51:09 2022] POST /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b/os-volume_attachments => generated 188 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 18:51:10.620237 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-03bba810-4f60-444a-99cf-9d370a16a994 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:10.620763 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-03bba810-4f60-444a-99cf-9d370a16a994 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:10.627267 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-03bba810-4f60-444a-99cf-9d370a16a994 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:10.627718 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-03bba810-4f60-444a-99cf-9d370a16a994 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:10.628479 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-03bba810-4f60-444a-99cf-9d370a16a994 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:10.628925 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-03bba810-4f60-444a-99cf-9d370a16a994 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:10.710487 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:11.098676 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-45f7e6d5-d7cc-4ded-85e9-c9898565addf tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:11.099694 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-45f7e6d5-d7cc-4ded-85e9-c9898565addf tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:11.106906 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-45f7e6d5-d7cc-4ded-85e9-c9898565addf tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:11.107352 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-45f7e6d5-d7cc-4ded-85e9-c9898565addf tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:11.108121 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-45f7e6d5-d7cc-4ded-85e9-c9898565addf tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:11.108558 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-45f7e6d5-d7cc-4ded-85e9-c9898565addf tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:11.137245 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-45f7e6d5-d7cc-4ded-85e9-c9898565addf tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043921 Jun 27 18:51:11.137818 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 351/706] 10.222.0.15 () {58 vars in 1301 bytes} [Mon Jun 27 18:51:11 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 27 18:51:11.157778 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-03bba810-4f60-444a-99cf-9d370a16a994 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b/os-volume_attachments/9194eb40-79cc-4c45-b499-dc25241478ff" status: 202 len: 0 microversion: 2.20 time: 0.540872 Jun 27 18:51:11.159764 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 356/707] 10.222.0.15 () {60 vars in 1456 bytes} [Mon Jun 27 18:51:10 2022] DELETE /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b/os-volume_attachments/9194eb40-79cc-4c45-b499-dc25241478ff => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 18:51:11.219286 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-98b0b1a8-2666-4952-998b-2c6b1f696500 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:11.219919 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-98b0b1a8-2666-4952-998b-2c6b1f696500 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:11.226445 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-98b0b1a8-2666-4952-998b-2c6b1f696500 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:11.229528 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-98b0b1a8-2666-4952-998b-2c6b1f696500 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:11.229528 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-98b0b1a8-2666-4952-998b-2c6b1f696500 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:11.229528 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-98b0b1a8-2666-4952-998b-2c6b1f696500 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:11.229911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-471dfd2d-5254-44fa-9e7c-ac0a83193517 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:51:11.229911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-471dfd2d-5254-44fa-9e7c-ac0a83193517 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:11.235541 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-471dfd2d-5254-44fa-9e7c-ac0a83193517 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:11.235990 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-471dfd2d-5254-44fa-9e7c-ac0a83193517 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:11.236770 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-471dfd2d-5254-44fa-9e7c-ac0a83193517 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:11.237208 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-471dfd2d-5254-44fa-9e7c-ac0a83193517 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:11.254038 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-98b0b1a8-2666-4952-998b-2c6b1f696500 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Going to try to terminate instance {{(pid=124717) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 18:51:11.468850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-471dfd2d-5254-44fa-9e7c-ac0a83193517 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "POST /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b/action" status: 202 len: 0 microversion: 2.20 time: 0.244271 Jun 27 18:51:11.469370 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 357/708] 10.222.0.15 () {62 vars in 1318 bytes} [Mon Jun 27 18:51:11 2022] POST /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 18:51:11.478533 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-d5944697-69a3-485a-9997-75eed5c7a995 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:11.479250 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-d5944697-69a3-485a-9997-75eed5c7a995 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:11.485343 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d5944697-69a3-485a-9997-75eed5c7a995 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:11.486588 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d5944697-69a3-485a-9997-75eed5c7a995 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:11.487338 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d5944697-69a3-485a-9997-75eed5c7a995 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:11.487771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d5944697-69a3-485a-9997-75eed5c7a995 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:11.500616 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-98b0b1a8-2666-4952-998b-2c6b1f696500 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 204 len: 0 microversion: 2.1 time: 0.285080 Jun 27 18:51:11.505895 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 352/709] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:51:11 2022] DELETE /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 18:51:11.509732 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-bad4b89c-a594-47c1-b9fc-98d1ce01d0e7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:11.510670 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-bad4b89c-a594-47c1-b9fc-98d1ce01d0e7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:11.517385 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bad4b89c-a594-47c1-b9fc-98d1ce01d0e7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:11.517858 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bad4b89c-a594-47c1-b9fc-98d1ce01d0e7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:11.518680 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bad4b89c-a594-47c1-b9fc-98d1ce01d0e7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:11.519211 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bad4b89c-a594-47c1-b9fc-98d1ce01d0e7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:11.696306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-d5944697-69a3-485a-9997-75eed5c7a995 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:11.705301 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-d5944697-69a3-485a-9997-75eed5c7a995 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:11.707021 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-d5944697-69a3-485a-9997-75eed5c7a995 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:11.707380 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-bad4b89c-a594-47c1-b9fc-98d1ce01d0e7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:11.708050 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-d5944697-69a3-485a-9997-75eed5c7a995 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1669 microversion: 2.20 time: 0.233756 Jun 27 18:51:11.708884 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 358/710] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:11 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1669 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:51:11.717186 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-bad4b89c-a594-47c1-b9fc-98d1ce01d0e7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1687 microversion: 2.1 time: 0.211372 Jun 27 18:51:11.717686 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 353/711] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:11 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1687 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:51:12.726856 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-1918e2ce-8860-4701-9eb9-fb96e7f5d206 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:12.727519 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-1918e2ce-8860-4701-9eb9-fb96e7f5d206 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:12.733941 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-01f179ff-55e3-45a0-abe8-64872b3f7911 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:12.736389 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1918e2ce-8860-4701-9eb9-fb96e7f5d206 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:12.736389 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1918e2ce-8860-4701-9eb9-fb96e7f5d206 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:12.736598 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-01f179ff-55e3-45a0-abe8-64872b3f7911 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:12.736693 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1918e2ce-8860-4701-9eb9-fb96e7f5d206 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:12.736693 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1918e2ce-8860-4701-9eb9-fb96e7f5d206 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:12.742357 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-01f179ff-55e3-45a0-abe8-64872b3f7911 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:12.742775 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-01f179ff-55e3-45a0-abe8-64872b3f7911 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:12.743562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-01f179ff-55e3-45a0-abe8-64872b3f7911 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:12.744059 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-01f179ff-55e3-45a0-abe8-64872b3f7911 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:12.932411 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-1918e2ce-8860-4701-9eb9-fb96e7f5d206 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:12.939258 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-01f179ff-55e3-45a0-abe8-64872b3f7911 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:12.944576 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-1918e2ce-8860-4701-9eb9-fb96e7f5d206 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:12.946075 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-1918e2ce-8860-4701-9eb9-fb96e7f5d206 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:12.946936 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-01f179ff-55e3-45a0-abe8-64872b3f7911 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1687 microversion: 2.1 time: 0.216919 Jun 27 18:51:12.947308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-1918e2ce-8860-4701-9eb9-fb96e7f5d206 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1669 microversion: 2.20 time: 0.224425 Jun 27 18:51:12.947508 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 354/712] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:12 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1687 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:51:12.947852 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 359/713] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:12 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1669 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:51:13.963885 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-18d9177a-0672-41b3-808e-fc869f5a1237 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:13.964407 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-18d9177a-0672-41b3-808e-fc869f5a1237 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:13.964625 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-8411571b-2a57-4c27-b059-e14a7680c31c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:13.965237 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-8411571b-2a57-4c27-b059-e14a7680c31c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:13.971222 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-18d9177a-0672-41b3-808e-fc869f5a1237 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:13.971682 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-18d9177a-0672-41b3-808e-fc869f5a1237 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:13.971834 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8411571b-2a57-4c27-b059-e14a7680c31c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:13.972161 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8411571b-2a57-4c27-b059-e14a7680c31c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:13.972455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-18d9177a-0672-41b3-808e-fc869f5a1237 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:13.972898 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-18d9177a-0672-41b3-808e-fc869f5a1237 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:13.973009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8411571b-2a57-4c27-b059-e14a7680c31c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:13.973326 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8411571b-2a57-4c27-b059-e14a7680c31c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:14.168616 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-8411571b-2a57-4c27-b059-e14a7680c31c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:14.171889 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-18d9177a-0672-41b3-808e-fc869f5a1237 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:14.178016 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-8411571b-2a57-4c27-b059-e14a7680c31c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:14.179504 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-18d9177a-0672-41b3-808e-fc869f5a1237 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1687 microversion: 2.1 time: 0.219547 Jun 27 18:51:14.179635 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-8411571b-2a57-4c27-b059-e14a7680c31c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:14.180074 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 355/714] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:13 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1687 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:51:14.180683 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-8411571b-2a57-4c27-b059-e14a7680c31c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1669 microversion: 2.20 time: 0.219865 Jun 27 18:51:14.181471 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 360/715] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:13 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1669 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:51:15.147062 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-5f270ec7-5add-4387-9dbc-fc49bd82a6cf tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:15.147759 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-5f270ec7-5add-4387-9dbc-fc49bd82a6cf tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:15.155429 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5f270ec7-5add-4387-9dbc-fc49bd82a6cf tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:15.155934 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5f270ec7-5add-4387-9dbc-fc49bd82a6cf tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:15.156696 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5f270ec7-5add-4387-9dbc-fc49bd82a6cf tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:15.157128 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5f270ec7-5add-4387-9dbc-fc49bd82a6cf tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:15.183035 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-5f270ec7-5add-4387-9dbc-fc49bd82a6cf tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/ips" status: 200 len: 145 microversion: 2.1 time: 0.041703 Jun 27 18:51:15.189211 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 356/716] 10.222.0.15 () {58 vars in 1247 bytes} [Mon Jun 27 18:51:15 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/ips => generated 145 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:51:15.199568 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-35b25abb-76de-4d4a-9d98-4982c686a404 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:15.200218 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-35b25abb-76de-4d4a-9d98-4982c686a404 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:15.208217 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-35b25abb-76de-4d4a-9d98-4982c686a404 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:15.208673 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-35b25abb-76de-4d4a-9d98-4982c686a404 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:15.211885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-35b25abb-76de-4d4a-9d98-4982c686a404 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:15.212325 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-35b25abb-76de-4d4a-9d98-4982c686a404 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:15.214009 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-2253d3cb-abda-44ab-829b-f44c0c062902 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:15.214655 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-2253d3cb-abda-44ab-829b-f44c0c062902 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:15.228966 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2253d3cb-abda-44ab-829b-f44c0c062902 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:15.233742 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2253d3cb-abda-44ab-829b-f44c0c062902 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:15.234627 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2253d3cb-abda-44ab-829b-f44c0c062902 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:15.235068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2253d3cb-abda-44ab-829b-f44c0c062902 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:15.559653 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-35b25abb-76de-4d4a-9d98-4982c686a404 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:15.566688 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-2253d3cb-abda-44ab-829b-f44c0c062902 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:15.567311 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-35b25abb-76de-4d4a-9d98-4982c686a404 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1687 microversion: 2.1 time: 0.373441 Jun 27 18:51:15.568122 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 361/717] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:15 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1687 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:51:15.575159 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-2253d3cb-abda-44ab-829b-f44c0c062902 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:15.576721 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-2253d3cb-abda-44ab-829b-f44c0c062902 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:15.578077 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-2253d3cb-abda-44ab-829b-f44c0c062902 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1671 microversion: 2.20 time: 0.382294 Jun 27 18:51:15.578942 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 357/718] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:15 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1671 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:51:16.146874 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-f41c3d58-14c1-4cb7-a732-a04ea0c41c1a req-6c7a9116-2b10-4274-83d3-2da163839fba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c18b111d-f2de-41ac-8ae4-6738845259fb", "name": "network-vif-deleted", "tag": "e7f919f9-9aa0-4ce8-a9d5-eaf1aec06292"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:51:16.154930 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-f41c3d58-14c1-4cb7-a732-a04ea0c41c1a req-6c7a9116-2b10-4274-83d3-2da163839fba service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:16.155531 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-f41c3d58-14c1-4cb7-a732-a04ea0c41c1a req-6c7a9116-2b10-4274-83d3-2da163839fba service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:16.167387 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-f41c3d58-14c1-4cb7-a732-a04ea0c41c1a req-6c7a9116-2b10-4274-83d3-2da163839fba service nova] Creating event network-vif-deleted:e7f919f9-9aa0-4ce8-a9d5-eaf1aec06292 for instance c18b111d-f2de-41ac-8ae4-6738845259fb on hv-cinder-84460 Jun 27 18:51:16.172240 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-f41c3d58-14c1-4cb7-a732-a04ea0c41c1a req-6c7a9116-2b10-4274-83d3-2da163839fba service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029824 Jun 27 18:51:16.172825 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 362/719] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:51:16.584777 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-638e11c8-ba25-436f-9240-f5b5e4a0fdb7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:16.585402 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-638e11c8-ba25-436f-9240-f5b5e4a0fdb7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:16.593478 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-638e11c8-ba25-436f-9240-f5b5e4a0fdb7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:16.593943 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-638e11c8-ba25-436f-9240-f5b5e4a0fdb7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:16.594932 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-638e11c8-ba25-436f-9240-f5b5e4a0fdb7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:16.595211 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-638e11c8-ba25-436f-9240-f5b5e4a0fdb7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:16.601978 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f3b93fd9-17b8-4694-bf7c-94a5e72a396a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:16.602722 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f3b93fd9-17b8-4694-bf7c-94a5e72a396a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:16.609894 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f3b93fd9-17b8-4694-bf7c-94a5e72a396a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:16.615103 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f3b93fd9-17b8-4694-bf7c-94a5e72a396a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:16.615103 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f3b93fd9-17b8-4694-bf7c-94a5e72a396a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:16.615103 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f3b93fd9-17b8-4694-bf7c-94a5e72a396a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:16.638104 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-638e11c8-ba25-436f-9240-f5b5e4a0fdb7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:16.638762 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-638e11c8-ba25-436f-9240-f5b5e4a0fdb7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:16.639330 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.objects.instance [None req-638e11c8-ba25-436f-9240-f5b5e4a0fdb7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lazy-loading 'fault' on Instance uuid c18b111d-f2de-41ac-8ae4-6738845259fb {{(pid=124717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:51:16.710850 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-638e11c8-ba25-436f-9240-f5b5e4a0fdb7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:16.719175 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-638e11c8-ba25-436f-9240-f5b5e4a0fdb7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 200 len: 1335 microversion: 2.1 time: 0.138135 Jun 27 18:51:16.720102 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 358/720] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:16 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 1335 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:51:16.782883 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f3b93fd9-17b8-4694-bf7c-94a5e72a396a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:16.792440 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f3b93fd9-17b8-4694-bf7c-94a5e72a396a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:16.793975 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f3b93fd9-17b8-4694-bf7c-94a5e72a396a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:16.795170 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f3b93fd9-17b8-4694-bf7c-94a5e72a396a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1727 microversion: 2.20 time: 0.197534 Jun 27 18:51:16.795785 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 363/721] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:16 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1727 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:51:16.881671 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e20f9e9b-0eb6-4cbf-ba93-f04e7dce07d2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "460b019b-5dd5-456e-864f-b1ba9cf2d376"}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:51:16.882861 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e20f9e9b-0eb6-4cbf-ba93-f04e7dce07d2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:16.890459 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e20f9e9b-0eb6-4cbf-ba93-f04e7dce07d2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:16.893742 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e20f9e9b-0eb6-4cbf-ba93-f04e7dce07d2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:16.894836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e20f9e9b-0eb6-4cbf-ba93-f04e7dce07d2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:16.895281 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e20f9e9b-0eb6-4cbf-ba93-f04e7dce07d2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:17.736130 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-4f2e56a7-655a-4e52-ab4e-2db72a01d101 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:17.737002 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-4f2e56a7-655a-4e52-ab4e-2db72a01d101 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: c18b111d-f2de-41ac-8ae4-6738845259fb] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:17.744315 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4f2e56a7-655a-4e52-ab4e-2db72a01d101 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:17.744771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4f2e56a7-655a-4e52-ab4e-2db72a01d101 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:17.745578 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4f2e56a7-655a-4e52-ab4e-2db72a01d101 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:17.746124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4f2e56a7-655a-4e52-ab4e-2db72a01d101 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:17.760816 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-4f2e56a7-655a-4e52-ab4e-2db72a01d101 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] HTTP exception thrown: Instance c18b111d-f2de-41ac-8ae4-6738845259fb could not be found. Jun 27 18:51:17.762579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-4f2e56a7-655a-4e52-ab4e-2db72a01d101 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Request method failure captured: Jun 27 18:51:17.762579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb HTTP/1.1 Jun 27 18:51:17.762579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:51:17.762579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:51:17.762579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:51:17.762579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:51:17.762579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:51:17.762579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:51:17.762579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:51:17.762579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:51:17.762579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufsgqlfv0hokCGUzepT1sutv3Om-w7VtAjx5eYoTAo_0yayA7H0lYzDj9boJX55FFsz4iaATtEf3QM_KAP0BkgCG_RMrK4v_pqEJJ5CyFPTwrTDg7mKbtZ6U0_Z0If7SY0B3k10FTMIMODcd34kBHuKTGz4_2o3EkBt1a5nCDWDysYk Jun 27 18:51:17.762579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:51:17.762579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:51:17.762579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:51:17.762579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:51:17.762579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:51:17.762579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:51:17.762579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: e03ab1e3fbe7445da087c631d8af557b Jun 27 18:51:17.762579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1545486903 Jun 27 18:51:17.762579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:51:17.762579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:51:17.764256 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e03ab1e3fbe7445da087c631d8af557b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e03ab1e3fbe7445da087c631d8af557b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e03ab1e3fbe7445da087c631d8af557b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e03ab1e3fbe7445da087c631d8af557b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:51:17.764256 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1545486903 Jun 27 18:51:17.764256 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: e03ab1e3fbe7445da087c631d8af557b Jun 27 18:51:17.764256 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1545486903 Jun 27 18:51:17.764256 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-ServerRescueNegativeTestJSON-1545486903-project Jun 27 18:51:17.764256 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:51:17.764256 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:51:17.764256 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: 78b6599200a94a2a8bcc0149dc22944d Jun 27 18:51:17.764256 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1545486903-project Jun 27 18:51:17.764256 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: > Jun 27 18:51:17.764256 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Instance c18b111d-f2de-41ac-8ae4-6738845259fb could not be found. Jun 27 18:51:17.764256 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': 'c18b111d-f2de-41ac-8ae4-6738845259fb'} Jun 27 18:51:17.765203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:51:17.765203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:51:17.765203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:51:17.765203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:51:17.765203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:51:17.765203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:51:17.765203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:51:17.765203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:51:17.765203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:51:17.765203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:51:17.765203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c18b111d-f2de-41ac-8ae4-6738845259fb could not be found. Jun 27 18:51:17.765203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:51:17.765203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:51:17.765203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:51:17.765203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:51:17.765203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:51:17.765203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:51:17.765203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:51:17.765203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:51:17.765203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:51:17.766873 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:51:17.766873 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:51:17.766873 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:51:17.766873 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:51:17.766873 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:51:17.766873 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:51:17.766873 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:51:17.766873 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c18b111d-f2de-41ac-8ae4-6738845259fb could not be found. Jun 27 18:51:17.766873 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:51:17.766873 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:51:17.766873 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:51:17.766873 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:51:17.766873 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:51:17.766873 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:51:17.766873 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:51:17.766873 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:51:17.766873 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c18b111d-f2de-41ac-8ae4-6738845259fb could not be found. Jun 27 18:51:17.766873 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:51:17.769065 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-4f2e56a7-655a-4e52-ab4e-2db72a01d101 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Returning 404 to user: Instance c18b111d-f2de-41ac-8ae4-6738845259fb could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:51:17.769065 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-4f2e56a7-655a-4e52-ab4e-2db72a01d101 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb" status: 404 len: 111 microversion: 2.1 time: 0.032009 Jun 27 18:51:17.769065 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 364/722] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:17 2022] GET /compute/v2.1/servers/c18b111d-f2de-41ac-8ae4-6738845259fb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 18:51:17.773613 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-81ec0404-9758-4562-b8f8-334f4c1704ca tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '.version_select at 0x7f700f623940>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:17.844658 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-81ec0404-9758-4562-b8f8-334f4c1704ca tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-942897981" status: 202 len: 0 microversion: 2.1 time: 0.074791 Jun 27 18:51:17.845234 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 365/723] 10.222.0.15 () {58 vars in 1217 bytes} [Mon Jun 27 18:51:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-942897981 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 18:51:17.850022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-73bea4ed-9b60-4182-9d21-f40a44a5819b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:17.850666 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-73bea4ed-9b60-4182-9d21-f40a44a5819b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:17.858587 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-73bea4ed-9b60-4182-9d21-f40a44a5819b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:17.859067 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-73bea4ed-9b60-4182-9d21-f40a44a5819b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:17.859881 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-73bea4ed-9b60-4182-9d21-f40a44a5819b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:17.860329 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-73bea4ed-9b60-4182-9d21-f40a44a5819b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:18.027355 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-73bea4ed-9b60-4182-9d21-f40a44a5819b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:18.036361 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-73bea4ed-9b60-4182-9d21-f40a44a5819b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:18.037855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-73bea4ed-9b60-4182-9d21-f40a44a5819b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:18.039049 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-73bea4ed-9b60-4182-9d21-f40a44a5819b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1727 microversion: 2.20 time: 0.192832 Jun 27 18:51:18.039593 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 366/724] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:17 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1727 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:51:19.058792 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-850f3dcc-a83b-4a05-be32-7f60a943d743 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:19.059494 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-850f3dcc-a83b-4a05-be32-7f60a943d743 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:19.068388 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-850f3dcc-a83b-4a05-be32-7f60a943d743 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:19.069288 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-850f3dcc-a83b-4a05-be32-7f60a943d743 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:19.070990 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-850f3dcc-a83b-4a05-be32-7f60a943d743 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:19.071850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-850f3dcc-a83b-4a05-be32-7f60a943d743 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:19.220088 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-850f3dcc-a83b-4a05-be32-7f60a943d743 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:19.230786 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-850f3dcc-a83b-4a05-be32-7f60a943d743 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:19.232293 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-850f3dcc-a83b-4a05-be32-7f60a943d743 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:19.233482 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-850f3dcc-a83b-4a05-be32-7f60a943d743 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1727 microversion: 2.20 time: 0.179310 Jun 27 18:51:19.245430 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 367/725] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:19 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:51:20.253692 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-afe1702d-5f89-4591-bc3d-a1c4a35d7907 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:20.254599 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-afe1702d-5f89-4591-bc3d-a1c4a35d7907 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:20.260963 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-afe1702d-5f89-4591-bc3d-a1c4a35d7907 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:20.261417 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-afe1702d-5f89-4591-bc3d-a1c4a35d7907 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:20.262194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-afe1702d-5f89-4591-bc3d-a1c4a35d7907 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:20.262658 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-afe1702d-5f89-4591-bc3d-a1c4a35d7907 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:20.408163 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-afe1702d-5f89-4591-bc3d-a1c4a35d7907 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:20.417112 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-afe1702d-5f89-4591-bc3d-a1c4a35d7907 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:20.418656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-afe1702d-5f89-4591-bc3d-a1c4a35d7907 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:20.419846 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-afe1702d-5f89-4591-bc3d-a1c4a35d7907 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1727 microversion: 2.20 time: 0.170852 Jun 27 18:51:20.420401 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 368/726] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:20 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:51:21.205274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-076afaaa-e2e7-4039-9897-8d4bcdbffb14 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:21.206045 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-076afaaa-e2e7-4039-9897-8d4bcdbffb14 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:21.212373 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-076afaaa-e2e7-4039-9897-8d4bcdbffb14 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:21.213022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-076afaaa-e2e7-4039-9897-8d4bcdbffb14 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:21.213955 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-076afaaa-e2e7-4039-9897-8d4bcdbffb14 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:21.214606 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-076afaaa-e2e7-4039-9897-8d4bcdbffb14 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:21.244618 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-076afaaa-e2e7-4039-9897-8d4bcdbffb14 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Going to try to terminate instance {{(pid=124716) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 18:51:21.775819 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-076afaaa-e2e7-4039-9897-8d4bcdbffb14 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 204 len: 0 microversion: 2.1 time: 0.573914 Jun 27 18:51:21.779689 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 369/727] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:51:21 2022] DELETE /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 18:51:21.786524 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a83e1078-607e-4b2f-8438-4d8da54e9c19 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:21.787228 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a83e1078-607e-4b2f-8438-4d8da54e9c19 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:21.793332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a83e1078-607e-4b2f-8438-4d8da54e9c19 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:21.793778 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a83e1078-607e-4b2f-8438-4d8da54e9c19 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:21.794577 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a83e1078-607e-4b2f-8438-4d8da54e9c19 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:21.795011 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a83e1078-607e-4b2f-8438-4d8da54e9c19 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:21.943846 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a83e1078-607e-4b2f-8438-4d8da54e9c19 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:21.952284 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a83e1078-607e-4b2f-8438-4d8da54e9c19 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:21.954016 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a83e1078-607e-4b2f-8438-4d8da54e9c19 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:21.955891 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a83e1078-607e-4b2f-8438-4d8da54e9c19 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1727 microversion: 2.20 time: 0.174270 Jun 27 18:51:21.956669 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 370/728] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:21 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:51:21.961018 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-d6c31968-522e-4799-9f71-148dffc3142e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:21.961699 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-d6c31968-522e-4799-9f71-148dffc3142e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:21.971366 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d6c31968-522e-4799-9f71-148dffc3142e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:21.972250 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d6c31968-522e-4799-9f71-148dffc3142e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:21.972724 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d6c31968-522e-4799-9f71-148dffc3142e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:21.973263 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d6c31968-522e-4799-9f71-148dffc3142e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:21.976299 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:22.117714 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-d6c31968-522e-4799-9f71-148dffc3142e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:22.125371 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-d6c31968-522e-4799-9f71-148dffc3142e tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1507 microversion: 2.1 time: 0.167902 Jun 27 18:51:22.125953 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 371/729] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:21 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:51:22.976408 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-61cbfbba-4bdd-47f7-98cd-a9ad0c782d18 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:22.977165 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-61cbfbba-4bdd-47f7-98cd-a9ad0c782d18 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:22.983680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-61cbfbba-4bdd-47f7-98cd-a9ad0c782d18 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:22.984124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-61cbfbba-4bdd-47f7-98cd-a9ad0c782d18 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:22.984889 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-61cbfbba-4bdd-47f7-98cd-a9ad0c782d18 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:22.985317 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-61cbfbba-4bdd-47f7-98cd-a9ad0c782d18 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:23.125596 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-61cbfbba-4bdd-47f7-98cd-a9ad0c782d18 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:23.133943 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-61cbfbba-4bdd-47f7-98cd-a9ad0c782d18 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:23.135488 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-61cbfbba-4bdd-47f7-98cd-a9ad0c782d18 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:23.136699 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-61cbfbba-4bdd-47f7-98cd-a9ad0c782d18 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1727 microversion: 2.20 time: 0.165095 Jun 27 18:51:23.148529 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 372/730] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:22 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:51:23.153461 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-bb7cf432-3540-418a-a659-781b4bcef107 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:23.154086 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-bb7cf432-3540-418a-a659-781b4bcef107 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:23.160477 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bb7cf432-3540-418a-a659-781b4bcef107 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:23.160928 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bb7cf432-3540-418a-a659-781b4bcef107 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:23.161734 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bb7cf432-3540-418a-a659-781b4bcef107 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:23.162180 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bb7cf432-3540-418a-a659-781b4bcef107 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:23.546135 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-bb7cf432-3540-418a-a659-781b4bcef107 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:23.553961 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-bb7cf432-3540-418a-a659-781b4bcef107 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1507 microversion: 2.1 time: 0.404240 Jun 27 18:51:23.554830 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 373/731] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:23 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1507 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:51:24.156136 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-1554efc0-d09b-425d-9f2e-11317cdb033c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:24.156885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-1554efc0-d09b-425d-9f2e-11317cdb033c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:24.166074 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1554efc0-d09b-425d-9f2e-11317cdb033c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:24.166560 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1554efc0-d09b-425d-9f2e-11317cdb033c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:24.167524 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1554efc0-d09b-425d-9f2e-11317cdb033c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:24.167972 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1554efc0-d09b-425d-9f2e-11317cdb033c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:24.307807 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-1554efc0-d09b-425d-9f2e-11317cdb033c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:24.316666 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-1554efc0-d09b-425d-9f2e-11317cdb033c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:24.318180 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-1554efc0-d09b-425d-9f2e-11317cdb033c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:24.319513 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-1554efc0-d09b-425d-9f2e-11317cdb033c tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1727 microversion: 2.20 time: 0.167259 Jun 27 18:51:24.319979 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 374/732] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:24 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:51:24.571397 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-fd1c7fad-f97a-4382-8ae5-255bfbc40ceb tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:24.572220 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-fd1c7fad-f97a-4382-8ae5-255bfbc40ceb tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:24.578349 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd1c7fad-f97a-4382-8ae5-255bfbc40ceb tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:24.578896 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd1c7fad-f97a-4382-8ae5-255bfbc40ceb tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:24.579728 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd1c7fad-f97a-4382-8ae5-255bfbc40ceb tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:24.580486 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd1c7fad-f97a-4382-8ae5-255bfbc40ceb tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:24.720422 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-fd1c7fad-f97a-4382-8ae5-255bfbc40ceb tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:24.730127 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-fd1c7fad-f97a-4382-8ae5-255bfbc40ceb tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1507 microversion: 2.1 time: 0.162554 Jun 27 18:51:24.730775 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 375/733] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:24 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:51:25.338896 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-81c37ad0-c1dc-4691-b27e-008a1dfeaadc tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:25.339580 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-81c37ad0-c1dc-4691-b27e-008a1dfeaadc tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:25.347174 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-81c37ad0-c1dc-4691-b27e-008a1dfeaadc tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:25.347626 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-81c37ad0-c1dc-4691-b27e-008a1dfeaadc tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:25.348393 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-81c37ad0-c1dc-4691-b27e-008a1dfeaadc tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:25.348838 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-81c37ad0-c1dc-4691-b27e-008a1dfeaadc tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:25.476185 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-81c37ad0-c1dc-4691-b27e-008a1dfeaadc tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:25.484102 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-81c37ad0-c1dc-4691-b27e-008a1dfeaadc tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:25.485618 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-81c37ad0-c1dc-4691-b27e-008a1dfeaadc tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:25.487040 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-81c37ad0-c1dc-4691-b27e-008a1dfeaadc tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1727 microversion: 2.20 time: 0.152028 Jun 27 18:51:25.487606 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 376/734] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:25 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:51:25.750818 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-9f46df10-0444-435b-84a1-07a629b4f418 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:25.751982 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-9f46df10-0444-435b-84a1-07a629b4f418 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:25.758374 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9f46df10-0444-435b-84a1-07a629b4f418 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:25.758851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9f46df10-0444-435b-84a1-07a629b4f418 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:25.759615 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9f46df10-0444-435b-84a1-07a629b4f418 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:25.760049 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9f46df10-0444-435b-84a1-07a629b4f418 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:25.894788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-9f46df10-0444-435b-84a1-07a629b4f418 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:25.902223 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-9f46df10-0444-435b-84a1-07a629b4f418 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1507 microversion: 2.1 time: 0.157360 Jun 27 18:51:25.902815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 377/735] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:25 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:51:26.058827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e20f9e9b-0eb6-4cbf-ba93-f04e7dce07d2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "POST /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.181099 Jun 27 18:51:26.059635 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 359/736] 10.222.0.15 () {60 vars in 1322 bytes} [Mon Jun 27 18:51:16 2022] POST /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/os-volume_attachments => generated 194 bytes in 9183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:51:26.505749 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-3dbba942-8676-4ab0-a097-a707755d9cc1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:26.506373 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-3dbba942-8676-4ab0-a097-a707755d9cc1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:26.512880 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3dbba942-8676-4ab0-a097-a707755d9cc1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:26.513333 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3dbba942-8676-4ab0-a097-a707755d9cc1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:26.514095 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3dbba942-8676-4ab0-a097-a707755d9cc1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:26.514565 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3dbba942-8676-4ab0-a097-a707755d9cc1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:26.643197 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3dbba942-8676-4ab0-a097-a707755d9cc1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:26.651095 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3dbba942-8676-4ab0-a097-a707755d9cc1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:26.652636 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3dbba942-8676-4ab0-a097-a707755d9cc1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:26.653806 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-3dbba942-8676-4ab0-a097-a707755d9cc1 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1727 microversion: 2.20 time: 0.152637 Jun 27 18:51:26.654370 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 378/737] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:26 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:51:26.916646 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:26.920807 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0b44425d-8dc5-46e0-a74b-0b6dde08a790 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:26.921499 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-0b44425d-8dc5-46e0-a74b-0b6dde08a790 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:26.927703 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0b44425d-8dc5-46e0-a74b-0b6dde08a790 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:26.928531 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0b44425d-8dc5-46e0-a74b-0b6dde08a790 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:26.929091 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0b44425d-8dc5-46e0-a74b-0b6dde08a790 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:26.929527 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0b44425d-8dc5-46e0-a74b-0b6dde08a790 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:27.063819 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-0b44425d-8dc5-46e0-a74b-0b6dde08a790 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:27.071335 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-0b44425d-8dc5-46e0-a74b-0b6dde08a790 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1507 microversion: 2.1 time: 0.156005 Jun 27 18:51:27.078636 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 360/738] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:26 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:51:27.672376 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-b8f5ff2f-df7a-49b2-be4c-434d7132ed11 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:27.673103 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-b8f5ff2f-df7a-49b2-be4c-434d7132ed11 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:27.680113 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b8f5ff2f-df7a-49b2-be4c-434d7132ed11 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:27.680559 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b8f5ff2f-df7a-49b2-be4c-434d7132ed11 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:27.681321 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b8f5ff2f-df7a-49b2-be4c-434d7132ed11 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:27.681757 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b8f5ff2f-df7a-49b2-be4c-434d7132ed11 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:27.816775 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-b8f5ff2f-df7a-49b2-be4c-434d7132ed11 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:27.824802 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-b8f5ff2f-df7a-49b2-be4c-434d7132ed11 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:27.826306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-b8f5ff2f-df7a-49b2-be4c-434d7132ed11 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:27.827507 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-b8f5ff2f-df7a-49b2-be4c-434d7132ed11 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1727 microversion: 2.20 time: 0.159086 Jun 27 18:51:27.828062 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 379/739] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:27 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:51:28.089280 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0c809bc7-5af5-4cf2-ae67-699bf7e4d152 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:28.089990 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-0c809bc7-5af5-4cf2-ae67-699bf7e4d152 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:28.096353 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0c809bc7-5af5-4cf2-ae67-699bf7e4d152 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:28.097348 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0c809bc7-5af5-4cf2-ae67-699bf7e4d152 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:28.098099 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0c809bc7-5af5-4cf2-ae67-699bf7e4d152 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:28.098573 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0c809bc7-5af5-4cf2-ae67-699bf7e4d152 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:28.229725 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-0c809bc7-5af5-4cf2-ae67-699bf7e4d152 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:28.237200 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-0c809bc7-5af5-4cf2-ae67-699bf7e4d152 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1507 microversion: 2.1 time: 0.151821 Jun 27 18:51:28.237888 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 361/740] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:28 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:51:28.845710 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-af2803ee-97f8-4312-81b8-181589be57fb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:28.846991 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-af2803ee-97f8-4312-81b8-181589be57fb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:28.853421 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-af2803ee-97f8-4312-81b8-181589be57fb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:28.853865 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-af2803ee-97f8-4312-81b8-181589be57fb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:28.854840 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-af2803ee-97f8-4312-81b8-181589be57fb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:28.855351 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-af2803ee-97f8-4312-81b8-181589be57fb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:28.996644 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-af2803ee-97f8-4312-81b8-181589be57fb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:29.005749 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-af2803ee-97f8-4312-81b8-181589be57fb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:29.006948 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-af2803ee-97f8-4312-81b8-181589be57fb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:29.008121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-af2803ee-97f8-4312-81b8-181589be57fb tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1727 microversion: 2.20 time: 0.166551 Jun 27 18:51:29.008674 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 380/741] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:28 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:51:29.256147 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-4a3c1986-5717-4ce5-ac02-0b3de3004386 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:29.256834 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-4a3c1986-5717-4ce5-ac02-0b3de3004386 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:29.264663 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4a3c1986-5717-4ce5-ac02-0b3de3004386 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:29.265554 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4a3c1986-5717-4ce5-ac02-0b3de3004386 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:29.266758 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4a3c1986-5717-4ce5-ac02-0b3de3004386 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:29.267414 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4a3c1986-5717-4ce5-ac02-0b3de3004386 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:29.347633 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-82fc5cd0-6c26-4401-8341-d3a7400783e2 req-ed5120e7-a1f6-4aa6-883f-19ca7e024025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b43630d1-a618-48b7-9837-b88b6f99fe34", "name": "network-vif-deleted", "tag": "0b1ffb29-dfee-404e-889b-5d32165b9788"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:51:29.356660 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-82fc5cd0-6c26-4401-8341-d3a7400783e2 req-ed5120e7-a1f6-4aa6-883f-19ca7e024025 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:29.357113 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-82fc5cd0-6c26-4401-8341-d3a7400783e2 req-ed5120e7-a1f6-4aa6-883f-19ca7e024025 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:29.358502 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-4a3c1986-5717-4ce5-ac02-0b3de3004386 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:29.367461 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-4a3c1986-5717-4ce5-ac02-0b3de3004386 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 200 len: 1465 microversion: 2.1 time: 0.116826 Jun 27 18:51:29.368034 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 362/742] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:29 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 1465 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:51:29.373215 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-82fc5cd0-6c26-4401-8341-d3a7400783e2 req-ed5120e7-a1f6-4aa6-883f-19ca7e024025 service nova] Creating event network-vif-deleted:0b1ffb29-dfee-404e-889b-5d32165b9788 for instance b43630d1-a618-48b7-9837-b88b6f99fe34 on hv-cinder-84460 Jun 27 18:51:29.379341 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-82fc5cd0-6c26-4401-8341-d3a7400783e2 req-ed5120e7-a1f6-4aa6-883f-19ca7e024025 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036628 Jun 27 18:51:29.379947 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 381/743] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:51:29.762341 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-ee012e95-de63-46bd-95a4-52e0d75fff2f req-00812506-94c7-4242-ad1f-b2c0c5ca84f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed77686-7baf-499a-9104-4bfe284ad76b", "name": "network-vif-plugged", "status": "completed", "tag": "c771ad0c-04e1-4dea-b13c-fbcf24ecd5ac"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:51:29.777891 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-ee012e95-de63-46bd-95a4-52e0d75fff2f req-00812506-94c7-4242-ad1f-b2c0c5ca84f9 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:29.777891 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-ee012e95-de63-46bd-95a4-52e0d75fff2f req-00812506-94c7-4242-ad1f-b2c0c5ca84f9 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:29.782289 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-ee012e95-de63-46bd-95a4-52e0d75fff2f req-00812506-94c7-4242-ad1f-b2c0c5ca84f9 service nova] Creating event network-vif-plugged:c771ad0c-04e1-4dea-b13c-fbcf24ecd5ac for instance 3ed77686-7baf-499a-9104-4bfe284ad76b on hv-cinder-84460 Jun 27 18:51:29.787169 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-ee012e95-de63-46bd-95a4-52e0d75fff2f req-00812506-94c7-4242-ad1f-b2c0c5ca84f9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028625 Jun 27 18:51:29.787750 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 363/744] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:51:30.027766 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a7f4d511-2634-4853-b48e-78dc8dc79b5f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:30.028467 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a7f4d511-2634-4853-b48e-78dc8dc79b5f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:30.034857 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a7f4d511-2634-4853-b48e-78dc8dc79b5f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:30.035307 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a7f4d511-2634-4853-b48e-78dc8dc79b5f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:30.036174 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a7f4d511-2634-4853-b48e-78dc8dc79b5f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:30.036610 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a7f4d511-2634-4853-b48e-78dc8dc79b5f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:30.168802 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a7f4d511-2634-4853-b48e-78dc8dc79b5f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:30.179227 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a7f4d511-2634-4853-b48e-78dc8dc79b5f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:30.180782 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a7f4d511-2634-4853-b48e-78dc8dc79b5f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:30.182015 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a7f4d511-2634-4853-b48e-78dc8dc79b5f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1727 microversion: 2.20 time: 0.159089 Jun 27 18:51:30.182597 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 382/745] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:30 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:51:30.385957 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-49912f5c-75f3-4c62-a286-312572856a56 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:30.386705 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-49912f5c-75f3-4c62-a286-312572856a56 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: b43630d1-a618-48b7-9837-b88b6f99fe34] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:30.393266 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-49912f5c-75f3-4c62-a286-312572856a56 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:30.393724 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-49912f5c-75f3-4c62-a286-312572856a56 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:30.394552 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-49912f5c-75f3-4c62-a286-312572856a56 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:30.394992 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-49912f5c-75f3-4c62-a286-312572856a56 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:30.412178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-49912f5c-75f3-4c62-a286-312572856a56 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] HTTP exception thrown: Instance b43630d1-a618-48b7-9837-b88b6f99fe34 could not be found. Jun 27 18:51:30.412178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-49912f5c-75f3-4c62-a286-312572856a56 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Request method failure captured: Jun 27 18:51:30.412178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 HTTP/1.1 Jun 27 18:51:30.412178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 18:51:30.412178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 18:51:30.412178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 18:51:30.412178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 0 Jun 27 18:51:30.412178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 18:51:30.412178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 18:51:30.412178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 18:51:30.412178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 18:51:30.412178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufsgqlfv0hokCGUzepT1sutv3Om-w7VtAjx5eYoTAo_0yayA7H0lYzDj9boJX55FFsz4iaATtEf3QM_KAP0BkgCG_RMrK4v_pqEJJ5CyFPTwrTDg7mKbtZ6U0_Z0If7SY0B3k10FTMIMODcd34kBHuKTGz4_2o3EkBt1a5nCDWDysYk Jun 27 18:51:30.412178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 18:51:30.412178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 18:51:30.412178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 18:51:30.412178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 18:51:30.412178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 18:51:30.412178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 18:51:30.412178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: e03ab1e3fbe7445da087c631d8af557b Jun 27 18:51:30.412178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1545486903 Jun 27 18:51:30.412178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 18:51:30.412178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 18:51:30.414116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e03ab1e3fbe7445da087c631d8af557b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e03ab1e3fbe7445da087c631d8af557b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e03ab1e3fbe7445da087c631d8af557b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e03ab1e3fbe7445da087c631d8af557b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:51:30.414116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1545486903 Jun 27 18:51:30.414116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: e03ab1e3fbe7445da087c631d8af557b Jun 27 18:51:30.414116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1545486903 Jun 27 18:51:30.414116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-ServerRescueNegativeTestJSON-1545486903-project Jun 27 18:51:30.414116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 18:51:30.414116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 18:51:30.414116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: 78b6599200a94a2a8bcc0149dc22944d Jun 27 18:51:30.414116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1545486903-project Jun 27 18:51:30.414116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: > Jun 27 18:51:30.414116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Instance b43630d1-a618-48b7-9837-b88b6f99fe34 could not be found. Jun 27 18:51:30.414116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'id': 'b43630d1-a618-48b7-9837-b88b6f99fe34'} Jun 27 18:51:30.415107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:51:30.415107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:51:30.415107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:51:30.415107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:51:30.415107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:51:30.415107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:51:30.415107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:51:30.415107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:51:30.415107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:51:30.415107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:51:30.415107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b43630d1-a618-48b7-9837-b88b6f99fe34 could not be found. Jun 27 18:51:30.415107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:51:30.415107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:51:30.415107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:51:30.415107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:51:30.415107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:51:30.415107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:51:30.415107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:51:30.415107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:51:30.415107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:51:30.416600 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:51:30.416600 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:51:30.416600 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:51:30.416600 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:51:30.416600 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:51:30.416600 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:51:30.416600 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:51:30.416600 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b43630d1-a618-48b7-9837-b88b6f99fe34 could not be found. Jun 27 18:51:30.416600 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:51:30.416600 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:51:30.416600 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:51:30.416600 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:51:30.416600 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:51:30.416600 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:51:30.416600 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:51:30.416600 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:51:30.416600 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b43630d1-a618-48b7-9837-b88b6f99fe34 could not be found. Jun 27 18:51:30.416600 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:51:30.417924 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-49912f5c-75f3-4c62-a286-312572856a56 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Returning 404 to user: Instance b43630d1-a618-48b7-9837-b88b6f99fe34 could not be found. {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:51:30.417924 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-49912f5c-75f3-4c62-a286-312572856a56 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34" status: 404 len: 111 microversion: 2.1 time: 0.030383 Jun 27 18:51:30.417924 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 364/746] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:30 2022] GET /compute/v2.1/servers/b43630d1-a618-48b7-9837-b88b6f99fe34 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:51:30.420011 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-68f62604-cce6-412c-ad09-85cb16c8872d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:30.420516 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-68f62604-cce6-412c-ad09-85cb16c8872d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:30.427071 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-68f62604-cce6-412c-ad09-85cb16c8872d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:30.427520 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-68f62604-cce6-412c-ad09-85cb16c8872d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:30.428276 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-68f62604-cce6-412c-ad09-85cb16c8872d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:30.428711 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-68f62604-cce6-412c-ad09-85cb16c8872d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:30.452460 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-68f62604-cce6-412c-ad09-85cb16c8872d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Going to try to terminate instance {{(pid=124716) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 18:51:30.712476 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-68f62604-cce6-412c-ad09-85cb16c8872d tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "DELETE /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 204 len: 0 microversion: 2.1 time: 0.295922 Jun 27 18:51:30.712992 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 383/747] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:51:30 2022] DELETE /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 18:51:30.720979 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-07182e85-c3be-462c-b424-d8fbbbc226dd tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:30.721657 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-07182e85-c3be-462c-b424-d8fbbbc226dd tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:30.728442 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-07182e85-c3be-462c-b424-d8fbbbc226dd tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:30.728897 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-07182e85-c3be-462c-b424-d8fbbbc226dd tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:30.729665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-07182e85-c3be-462c-b424-d8fbbbc226dd tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:30.730106 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-07182e85-c3be-462c-b424-d8fbbbc226dd tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:30.861931 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-07182e85-c3be-462c-b424-d8fbbbc226dd tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:30.866105 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:30.870432 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-07182e85-c3be-462c-b424-d8fbbbc226dd tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.153359 Jun 27 18:51:30.870983 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 365/748] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:30 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:51:31.201479 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a6a1a976-cb6c-4875-af82-97b31b958a0f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:31.202304 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a6a1a976-cb6c-4875-af82-97b31b958a0f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:31.204260 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:31.209788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a6a1a976-cb6c-4875-af82-97b31b958a0f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:31.210300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a6a1a976-cb6c-4875-af82-97b31b958a0f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:31.214561 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a6a1a976-cb6c-4875-af82-97b31b958a0f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:31.214561 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a6a1a976-cb6c-4875-af82-97b31b958a0f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:31.345568 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a6a1a976-cb6c-4875-af82-97b31b958a0f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:31.353347 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a6a1a976-cb6c-4875-af82-97b31b958a0f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:31.354883 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a6a1a976-cb6c-4875-af82-97b31b958a0f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:31.357740 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a6a1a976-cb6c-4875-af82-97b31b958a0f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1727 microversion: 2.20 time: 0.158874 Jun 27 18:51:31.357740 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 384/749] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:31 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:51:31.887823 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-51b0ec4a-15c5-41e5-abdd-eecee00abab8 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:31.888360 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-51b0ec4a-15c5-41e5-abdd-eecee00abab8 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:31.895547 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-51b0ec4a-15c5-41e5-abdd-eecee00abab8 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:31.895999 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-51b0ec4a-15c5-41e5-abdd-eecee00abab8 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:31.896763 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-51b0ec4a-15c5-41e5-abdd-eecee00abab8 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:31.897199 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-51b0ec4a-15c5-41e5-abdd-eecee00abab8 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:32.030422 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-51b0ec4a-15c5-41e5-abdd-eecee00abab8 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:32.038353 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-51b0ec4a-15c5-41e5-abdd-eecee00abab8 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.154522 Jun 27 18:51:32.038939 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 366/750] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:31 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:51:32.374997 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-d986c6af-1988-4419-9552-375f5770bacf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:32.375607 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-d986c6af-1988-4419-9552-375f5770bacf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:32.383200 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d986c6af-1988-4419-9552-375f5770bacf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:32.383642 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d986c6af-1988-4419-9552-375f5770bacf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:32.384402 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d986c6af-1988-4419-9552-375f5770bacf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:32.384835 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d986c6af-1988-4419-9552-375f5770bacf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:32.515895 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-d986c6af-1988-4419-9552-375f5770bacf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:32.524312 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-d986c6af-1988-4419-9552-375f5770bacf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:32.525796 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-d986c6af-1988-4419-9552-375f5770bacf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:32.526979 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-d986c6af-1988-4419-9552-375f5770bacf tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1727 microversion: 2.20 time: 0.155947 Jun 27 18:51:32.527540 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 385/751] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:32 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:51:33.055488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-136f72aa-a157-4ac4-83c9-200455e65838 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:33.056138 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-136f72aa-a157-4ac4-83c9-200455e65838 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:33.062541 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-136f72aa-a157-4ac4-83c9-200455e65838 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:33.062985 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-136f72aa-a157-4ac4-83c9-200455e65838 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:33.063740 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-136f72aa-a157-4ac4-83c9-200455e65838 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:33.064172 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-136f72aa-a157-4ac4-83c9-200455e65838 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:33.193004 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-136f72aa-a157-4ac4-83c9-200455e65838 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:33.200723 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-136f72aa-a157-4ac4-83c9-200455e65838 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.149123 Jun 27 18:51:33.201390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 367/752] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:33 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:51:33.545429 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-c36c17b0-7568-4f60-9f96-a06766ba32b4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:33.546043 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-c36c17b0-7568-4f60-9f96-a06766ba32b4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:33.553663 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c36c17b0-7568-4f60-9f96-a06766ba32b4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:33.554105 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c36c17b0-7568-4f60-9f96-a06766ba32b4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:33.554891 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c36c17b0-7568-4f60-9f96-a06766ba32b4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:33.555323 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c36c17b0-7568-4f60-9f96-a06766ba32b4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:33.689450 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c36c17b0-7568-4f60-9f96-a06766ba32b4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:33.692469 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:33.698843 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c36c17b0-7568-4f60-9f96-a06766ba32b4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:33.700274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c36c17b0-7568-4f60-9f96-a06766ba32b4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:33.701436 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-c36c17b0-7568-4f60-9f96-a06766ba32b4 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1727 microversion: 2.20 time: 0.159939 Jun 27 18:51:33.701989 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 386/753] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:33 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:51:34.218065 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-1d3bf772-bf93-40af-a31c-4647643e3a22 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:34.218672 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-1d3bf772-bf93-40af-a31c-4647643e3a22 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:34.225220 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1d3bf772-bf93-40af-a31c-4647643e3a22 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:34.225665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1d3bf772-bf93-40af-a31c-4647643e3a22 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:34.226435 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1d3bf772-bf93-40af-a31c-4647643e3a22 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:34.226875 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1d3bf772-bf93-40af-a31c-4647643e3a22 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:34.360514 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-1d3bf772-bf93-40af-a31c-4647643e3a22 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:34.369501 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-1d3bf772-bf93-40af-a31c-4647643e3a22 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.155228 Jun 27 18:51:34.373459 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 368/754] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:34 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:51:34.719911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-1a0bd8db-2229-48cb-9277-a2f064a46235 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:34.720532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-1a0bd8db-2229-48cb-9277-a2f064a46235 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:34.727951 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1a0bd8db-2229-48cb-9277-a2f064a46235 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:34.728342 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1a0bd8db-2229-48cb-9277-a2f064a46235 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:34.729110 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1a0bd8db-2229-48cb-9277-a2f064a46235 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:34.729552 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1a0bd8db-2229-48cb-9277-a2f064a46235 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:34.868651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-1a0bd8db-2229-48cb-9277-a2f064a46235 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:34.879759 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-1a0bd8db-2229-48cb-9277-a2f064a46235 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:34.881662 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-1a0bd8db-2229-48cb-9277-a2f064a46235 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:34.883204 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-1a0bd8db-2229-48cb-9277-a2f064a46235 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1727 microversion: 2.20 time: 0.167165 Jun 27 18:51:34.884337 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 387/755] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:34 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:51:35.386971 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-98bc7e8f-d6a7-4f62-95e2-f052860324c7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:35.387590 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-98bc7e8f-d6a7-4f62-95e2-f052860324c7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:35.394174 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-98bc7e8f-d6a7-4f62-95e2-f052860324c7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:35.394667 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-98bc7e8f-d6a7-4f62-95e2-f052860324c7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:35.395451 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-98bc7e8f-d6a7-4f62-95e2-f052860324c7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:35.396195 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-98bc7e8f-d6a7-4f62-95e2-f052860324c7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:35.537700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-98bc7e8f-d6a7-4f62-95e2-f052860324c7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b6599200a94a2a8bcc0149dc22944d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03ab1e3fbe7445da087c631d8af557b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:35.549156 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-98bc7e8f-d6a7-4f62-95e2-f052860324c7 tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 200 len: 1522 microversion: 2.1 time: 0.165967 Jun 27 18:51:35.560382 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 369/756] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:35 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:51:35.595613 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-f2fbfc14-c76c-4e3a-9fcb-9a6e0d6214f9 req-692783ff-8514-4978-9a81-6ca337667e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "657439fb-0239-40b2-9be0-56c5b7dc558c", "name": "network-vif-deleted", "tag": "3ed5d7ea-357c-46c3-8977-0d7855beac6c"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:51:35.609935 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-f2fbfc14-c76c-4e3a-9fcb-9a6e0d6214f9 req-692783ff-8514-4978-9a81-6ca337667e9b service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:35.610419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-f2fbfc14-c76c-4e3a-9fcb-9a6e0d6214f9 req-692783ff-8514-4978-9a81-6ca337667e9b service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:35.621998 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-f2fbfc14-c76c-4e3a-9fcb-9a6e0d6214f9 req-692783ff-8514-4978-9a81-6ca337667e9b service nova] Creating event network-vif-deleted:3ed5d7ea-357c-46c3-8977-0d7855beac6c for instance 657439fb-0239-40b2-9be0-56c5b7dc558c on hv-cinder-84460 Jun 27 18:51:35.627308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-f2fbfc14-c76c-4e3a-9fcb-9a6e0d6214f9 req-692783ff-8514-4978-9a81-6ca337667e9b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035339 Jun 27 18:51:35.628408 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 388/757] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:51:35.901901 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-b35eead1-32b3-4083-8e8c-0eb864806f8f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:35.902854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-b35eead1-32b3-4083-8e8c-0eb864806f8f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:35.915798 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b35eead1-32b3-4083-8e8c-0eb864806f8f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:35.916655 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b35eead1-32b3-4083-8e8c-0eb864806f8f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:35.917712 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b35eead1-32b3-4083-8e8c-0eb864806f8f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:35.918155 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b35eead1-32b3-4083-8e8c-0eb864806f8f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:36.056424 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-b35eead1-32b3-4083-8e8c-0eb864806f8f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:36.064393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-b35eead1-32b3-4083-8e8c-0eb864806f8f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:36.066571 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-b35eead1-32b3-4083-8e8c-0eb864806f8f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:36.067782 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-b35eead1-32b3-4083-8e8c-0eb864806f8f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1714 microversion: 2.20 time: 0.169854 Jun 27 18:51:36.068345 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 370/758] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:51:35 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1714 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:51:36.568292 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-86eff574-5c40-4453-95c3-1f795919612a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:36.568920 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-86eff574-5c40-4453-95c3-1f795919612a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] [instance: 657439fb-0239-40b2-9be0-56c5b7dc558c] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:36.575425 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-86eff574-5c40-4453-95c3-1f795919612a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:36.575882 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-86eff574-5c40-4453-95c3-1f795919612a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:36.576643 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-86eff574-5c40-4453-95c3-1f795919612a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:36.577081 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-86eff574-5c40-4453-95c3-1f795919612a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:36.590009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-86eff574-5c40-4453-95c3-1f795919612a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] HTTP exception thrown: Instance 657439fb-0239-40b2-9be0-56c5b7dc558c could not be found. Jun 27 18:51:36.591691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-86eff574-5c40-4453-95c3-1f795919612a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Request method failure captured: Jun 27 18:51:36.591691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c HTTP/1.1 Jun 27 18:51:36.591691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:51:36.591691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:51:36.591691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:51:36.591691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:51:36.591691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:51:36.591691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:51:36.591691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:51:36.591691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:51:36.591691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufsgqlfv0hokCGUzepT1sutv3Om-w7VtAjx5eYoTAo_0yayA7H0lYzDj9boJX55FFsz4iaATtEf3QM_KAP0BkgCG_RMrK4v_pqEJJ5CyFPTwrTDg7mKbtZ6U0_Z0If7SY0B3k10FTMIMODcd34kBHuKTGz4_2o3EkBt1a5nCDWDysYk Jun 27 18:51:36.591691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:51:36.591691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:51:36.591691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:51:36.591691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:51:36.591691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:51:36.591691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:51:36.591691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: e03ab1e3fbe7445da087c631d8af557b Jun 27 18:51:36.591691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1545486903 Jun 27 18:51:36.591691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:51:36.591691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:51:36.593263 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e03ab1e3fbe7445da087c631d8af557b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e03ab1e3fbe7445da087c631d8af557b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e03ab1e3fbe7445da087c631d8af557b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e03ab1e3fbe7445da087c631d8af557b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:51:36.593263 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1545486903 Jun 27 18:51:36.593263 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: e03ab1e3fbe7445da087c631d8af557b Jun 27 18:51:36.593263 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1545486903 Jun 27 18:51:36.593263 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-ServerRescueNegativeTestJSON-1545486903-project Jun 27 18:51:36.593263 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:51:36.593263 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:51:36.593263 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: 78b6599200a94a2a8bcc0149dc22944d Jun 27 18:51:36.593263 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1545486903-project Jun 27 18:51:36.593263 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: > Jun 27 18:51:36.593263 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Instance 657439fb-0239-40b2-9be0-56c5b7dc558c could not be found. Jun 27 18:51:36.593263 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': '657439fb-0239-40b2-9be0-56c5b7dc558c'} Jun 27 18:51:36.594166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:51:36.594166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:51:36.594166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:51:36.594166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:51:36.594166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:51:36.594166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:51:36.594166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:51:36.594166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:51:36.594166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:51:36.594166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:51:36.594166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 657439fb-0239-40b2-9be0-56c5b7dc558c could not be found. Jun 27 18:51:36.594166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:51:36.594166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:51:36.594166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:51:36.594166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:51:36.594166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:51:36.594166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:51:36.594166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:51:36.594166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:51:36.594166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:51:36.595657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:51:36.595657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:51:36.595657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:51:36.595657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:51:36.595657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:51:36.595657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:51:36.595657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:51:36.595657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 657439fb-0239-40b2-9be0-56c5b7dc558c could not be found. Jun 27 18:51:36.595657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:51:36.595657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:51:36.595657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:51:36.595657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:51:36.595657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:51:36.595657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:51:36.595657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:51:36.595657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:51:36.595657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 657439fb-0239-40b2-9be0-56c5b7dc558c could not be found. Jun 27 18:51:36.595657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:51:36.597669 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-86eff574-5c40-4453-95c3-1f795919612a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] Returning 404 to user: Instance 657439fb-0239-40b2-9be0-56c5b7dc558c could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:51:36.597669 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-86eff574-5c40-4453-95c3-1f795919612a tempest-ServerRescueNegativeTestJSON-1545486903 tempest-ServerRescueNegativeTestJSON-1545486903-project] 10.222.0.15 "GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c" status: 404 len: 111 microversion: 2.1 time: 0.029826 Jun 27 18:51:36.597905 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 389/759] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:36 2022] GET /compute/v2.1/servers/657439fb-0239-40b2-9be0-56c5b7dc558c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:51:36.748214 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a9514e0a-b2b8-456a-9ab8-29674e08ae98 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:36.749131 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-a9514e0a-b2b8-456a-9ab8-29674e08ae98 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:36.756388 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a9514e0a-b2b8-456a-9ab8-29674e08ae98 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:36.756831 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a9514e0a-b2b8-456a-9ab8-29674e08ae98 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:36.757622 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a9514e0a-b2b8-456a-9ab8-29674e08ae98 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:36.758050 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a9514e0a-b2b8-456a-9ab8-29674e08ae98 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:36.787555 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-a9514e0a-b2b8-456a-9ab8-29674e08ae98 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043234 Jun 27 18:51:36.788124 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 371/760] 10.222.0.15 () {58 vars in 1301 bytes} [Mon Jun 27 18:51:36 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:51:36.797867 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-1988b7fa-c9d4-4d5e-902e-d3cad5d4020f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:36.798362 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-1988b7fa-c9d4-4d5e-902e-d3cad5d4020f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:36.804924 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1988b7fa-c9d4-4d5e-902e-d3cad5d4020f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:36.805374 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1988b7fa-c9d4-4d5e-902e-d3cad5d4020f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:36.806135 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1988b7fa-c9d4-4d5e-902e-d3cad5d4020f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:36.806600 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1988b7fa-c9d4-4d5e-902e-d3cad5d4020f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:36.835305 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-1988b7fa-c9d4-4d5e-902e-d3cad5d4020f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/os-volume_attachments/460b019b-5dd5-456e-864f-b1ba9cf2d376" status: 200 len: 194 microversion: 2.1 time: 0.041311 Jun 27 18:51:36.835892 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 390/761] 10.222.0.15 () {58 vars in 1412 bytes} [Mon Jun 27 18:51:36 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/os-volume_attachments/460b019b-5dd5-456e-864f-b1ba9cf2d376 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:51:38.340397 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-ee76c1e4-eb97-4962-ad68-7841d0fdbdf2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0cc969b-057c-4ff4-aa74-dc37dc1aa2d2"}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:51:38.342176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-ee76c1e4-eb97-4962-ad68-7841d0fdbdf2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:38.350953 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ee76c1e4-eb97-4962-ad68-7841d0fdbdf2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:38.351748 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ee76c1e4-eb97-4962-ad68-7841d0fdbdf2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:38.352908 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ee76c1e4-eb97-4962-ad68-7841d0fdbdf2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:38.353940 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ee76c1e4-eb97-4962-ad68-7841d0fdbdf2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:39.025669 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-ee76c1e4-eb97-4962-ad68-7841d0fdbdf2 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "POST /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.689124 Jun 27 18:51:39.026424 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 372/762] 10.222.0.15 () {60 vars in 1322 bytes} [Mon Jun 27 18:51:38 2022] POST /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/os-volume_attachments => generated 194 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:51:46.510833 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-ac53e7d9-2a99-4367-bd11-97120d480b6d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:46.511755 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-ac53e7d9-2a99-4367-bd11-97120d480b6d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:46.518467 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ac53e7d9-2a99-4367-bd11-97120d480b6d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:46.518917 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ac53e7d9-2a99-4367-bd11-97120d480b6d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:46.519671 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ac53e7d9-2a99-4367-bd11-97120d480b6d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:46.520103 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ac53e7d9-2a99-4367-bd11-97120d480b6d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:46.549366 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-ac53e7d9-2a99-4367-bd11-97120d480b6d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043636 Jun 27 18:51:46.549908 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 391/763] 10.222.0.15 () {58 vars in 1301 bytes} [Mon Jun 27 18:51:46 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:51:46.655131 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-c3a137d2-3b11-44eb-8b8f-1a0e354251db tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:46.655710 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-c3a137d2-3b11-44eb-8b8f-1a0e354251db tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:46.662072 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c3a137d2-3b11-44eb-8b8f-1a0e354251db tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:46.662553 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c3a137d2-3b11-44eb-8b8f-1a0e354251db tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:46.663319 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c3a137d2-3b11-44eb-8b8f-1a0e354251db tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:46.663762 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c3a137d2-3b11-44eb-8b8f-1a0e354251db tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:46.691621 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-c3a137d2-3b11-44eb-8b8f-1a0e354251db tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/os-volume_attachments/460b019b-5dd5-456e-864f-b1ba9cf2d376" status: 200 len: 194 microversion: 2.1 time: 0.041572 Jun 27 18:51:46.692181 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 373/764] 10.222.0.15 () {58 vars in 1412 bytes} [Mon Jun 27 18:51:46 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/os-volume_attachments/460b019b-5dd5-456e-864f-b1ba9cf2d376 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:51:46.702803 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-727af96f-d95f-4716-a619-1db72cb9e59d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:46.703302 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-727af96f-d95f-4716-a619-1db72cb9e59d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:46.709467 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-727af96f-d95f-4716-a619-1db72cb9e59d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:46.709914 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-727af96f-d95f-4716-a619-1db72cb9e59d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:46.710714 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-727af96f-d95f-4716-a619-1db72cb9e59d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:46.711150 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-727af96f-d95f-4716-a619-1db72cb9e59d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:46.790818 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.objects.instance [None req-727af96f-d95f-4716-a619-1db72cb9e59d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lazy-loading 'services' on Instance uuid 47f70d2d-989d-4644-89db-b4b37d5f07cc {{(pid=124716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:51:47.039912 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-727af96f-d95f-4716-a619-1db72cb9e59d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "DELETE /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/os-volume_attachments/460b019b-5dd5-456e-864f-b1ba9cf2d376" status: 202 len: 0 microversion: 2.1 time: 0.340888 Jun 27 18:51:47.040561 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 392/765] 10.222.0.15 () {58 vars in 1415 bytes} [Mon Jun 27 18:51:46 2022] DELETE /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/os-volume_attachments/460b019b-5dd5-456e-864f-b1ba9cf2d376 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:51:51.318671 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a41f9478-b87e-4703-941b-5dede1341f2d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:51.319228 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-a41f9478-b87e-4703-941b-5dede1341f2d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:51.325655 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a41f9478-b87e-4703-941b-5dede1341f2d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:51.326099 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a41f9478-b87e-4703-941b-5dede1341f2d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:51.326909 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a41f9478-b87e-4703-941b-5dede1341f2d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:51.327348 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a41f9478-b87e-4703-941b-5dede1341f2d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:51.358681 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-a41f9478-b87e-4703-941b-5dede1341f2d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/os-volume_attachments/c0cc969b-057c-4ff4-aa74-dc37dc1aa2d2" status: 200 len: 194 microversion: 2.1 time: 0.044096 Jun 27 18:51:51.359421 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 374/766] 10.222.0.15 () {58 vars in 1412 bytes} [Mon Jun 27 18:51:51 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/os-volume_attachments/c0cc969b-057c-4ff4-aa74-dc37dc1aa2d2 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:51:51.370839 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-957cff24-10ee-484d-bea3-253fdccb17a6 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:51.371425 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-957cff24-10ee-484d-bea3-253fdccb17a6 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:51.378166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-957cff24-10ee-484d-bea3-253fdccb17a6 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:51.378652 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-957cff24-10ee-484d-bea3-253fdccb17a6 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:51.379457 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-957cff24-10ee-484d-bea3-253fdccb17a6 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:51.379893 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-957cff24-10ee-484d-bea3-253fdccb17a6 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:51.459796 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.objects.instance [None req-957cff24-10ee-484d-bea3-253fdccb17a6 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lazy-loading 'services' on Instance uuid 47f70d2d-989d-4644-89db-b4b37d5f07cc {{(pid=124716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:51:51.672030 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-957cff24-10ee-484d-bea3-253fdccb17a6 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "DELETE /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/os-volume_attachments/c0cc969b-057c-4ff4-aa74-dc37dc1aa2d2" status: 202 len: 0 microversion: 2.1 time: 0.306405 Jun 27 18:51:51.672628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 393/767] 10.222.0.15 () {58 vars in 1415 bytes} [Mon Jun 27 18:51:51 2022] DELETE /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/os-volume_attachments/c0cc969b-057c-4ff4-aa74-dc37dc1aa2d2 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:51:52.832454 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-1a85f417-2fec-4cfe-9c6b-693502492bd8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:52.833445 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-1a85f417-2fec-4cfe-9c6b-693502492bd8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:52.840555 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1a85f417-2fec-4cfe-9c6b-693502492bd8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:52.844726 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1a85f417-2fec-4cfe-9c6b-693502492bd8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:52.844726 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1a85f417-2fec-4cfe-9c6b-693502492bd8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:52.844726 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1a85f417-2fec-4cfe-9c6b-693502492bd8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:52.871288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-1a85f417-2fec-4cfe-9c6b-693502492bd8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042655 Jun 27 18:51:52.871850 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 375/768] 10.222.0.15 () {58 vars in 1301 bytes} [Mon Jun 27 18:51:52 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 18:51:52.979163 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a1aa8cb8-df21-4975-86a2-eb8d066addee tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:52.980708 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a1aa8cb8-df21-4975-86a2-eb8d066addee tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:52.987394 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a1aa8cb8-df21-4975-86a2-eb8d066addee tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:52.987851 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a1aa8cb8-df21-4975-86a2-eb8d066addee tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:52.988625 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a1aa8cb8-df21-4975-86a2-eb8d066addee tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:52.989082 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a1aa8cb8-df21-4975-86a2-eb8d066addee tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:53.022486 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a1aa8cb8-df21-4975-86a2-eb8d066addee tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048108 Jun 27 18:51:53.023653 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 394/769] 10.222.0.15 () {58 vars in 1301 bytes} [Mon Jun 27 18:51:52 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 18:51:53.081516 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-95f5bf99-e908-4e38-98ea-c69b11a8ba06 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:53.085835 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-95f5bf99-e908-4e38-98ea-c69b11a8ba06 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:53.088451 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-95f5bf99-e908-4e38-98ea-c69b11a8ba06 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:53.088893 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-95f5bf99-e908-4e38-98ea-c69b11a8ba06 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:53.089654 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-95f5bf99-e908-4e38-98ea-c69b11a8ba06 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:53.090127 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-95f5bf99-e908-4e38-98ea-c69b11a8ba06 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:53.117261 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-95f5bf99-e908-4e38-98ea-c69b11a8ba06 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Going to try to terminate instance {{(pid=124717) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 18:51:53.387771 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-95f5bf99-e908-4e38-98ea-c69b11a8ba06 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "DELETE /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc" status: 204 len: 0 microversion: 2.1 time: 0.309853 Jun 27 18:51:53.388389 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 376/770] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:51:53 2022] DELETE /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 18:51:53.396664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-8e00aaf5-8813-4cf7-893c-3df8e1a8d745 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:53.397273 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-8e00aaf5-8813-4cf7-893c-3df8e1a8d745 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:53.403666 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8e00aaf5-8813-4cf7-893c-3df8e1a8d745 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:53.404114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8e00aaf5-8813-4cf7-893c-3df8e1a8d745 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:53.404871 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8e00aaf5-8813-4cf7-893c-3df8e1a8d745 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:53.405332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8e00aaf5-8813-4cf7-893c-3df8e1a8d745 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:53.554241 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-8e00aaf5-8813-4cf7-893c-3df8e1a8d745 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:53.562889 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-8e00aaf5-8813-4cf7-893c-3df8e1a8d745 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc" status: 200 len: 1674 microversion: 2.1 time: 0.170053 Jun 27 18:51:53.563461 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 395/771] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:53 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:51:54.293016 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a025f850-b4b6-4e27-b4d3-2300e4ea1797 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:51:54.293657 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-a025f850-b4b6-4e27-b4d3-2300e4ea1797 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:54.306304 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a025f850-b4b6-4e27-b4d3-2300e4ea1797 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:54.306304 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a025f850-b4b6-4e27-b4d3-2300e4ea1797 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:54.306304 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a025f850-b4b6-4e27-b4d3-2300e4ea1797 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:54.306304 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a025f850-b4b6-4e27-b4d3-2300e4ea1797 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:54.325595 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.objects.instance [None req-a025f850-b4b6-4e27-b4d3-2300e4ea1797 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lazy-loading 'flavor' on Instance uuid 2a731689-b26b-4f41-a3d3-4d1a2ebff239 {{(pid=124717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:51:54.500918 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:54.580464 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-ace306a5-de73-47e9-a031-e0644efdc20f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:54.581440 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-ace306a5-de73-47e9-a031-e0644efdc20f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:54.582729 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-a025f850-b4b6-4e27-b4d3-2300e4ea1797 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "POST /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239/action" status: 202 len: 0 microversion: 2.1 time: 0.294199 Jun 27 18:51:54.583336 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 377/772] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Jun 27 18:51:54 2022] POST /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:51:54.593099 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ace306a5-de73-47e9-a031-e0644efdc20f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:54.593624 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ace306a5-de73-47e9-a031-e0644efdc20f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:54.594489 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ace306a5-de73-47e9-a031-e0644efdc20f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:54.595085 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ace306a5-de73-47e9-a031-e0644efdc20f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:54.598056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e855d72e-f349-4b1b-b3b0-26a3fedb9be5 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:54.598056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e855d72e-f349-4b1b-b3b0-26a3fedb9be5 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:54.605665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e855d72e-f349-4b1b-b3b0-26a3fedb9be5 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:54.606112 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e855d72e-f349-4b1b-b3b0-26a3fedb9be5 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:54.606929 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e855d72e-f349-4b1b-b3b0-26a3fedb9be5 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:54.607360 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e855d72e-f349-4b1b-b3b0-26a3fedb9be5 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:54.808098 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-ace306a5-de73-47e9-a031-e0644efdc20f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:54.809590 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-e855d72e-f349-4b1b-b3b0-26a3fedb9be5 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:54.819378 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-ace306a5-de73-47e9-a031-e0644efdc20f tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc" status: 200 len: 1674 microversion: 2.1 time: 0.242855 Jun 27 18:51:54.822649 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 396/773] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:54 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc => generated 1674 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:51:54.836441 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e855d72e-f349-4b1b-b3b0-26a3fedb9be5 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1569 microversion: 2.1 time: 0.243772 Jun 27 18:51:54.836634 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 378/774] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:54 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1569 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:51:55.840572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-1fc79273-a4cd-4771-81a8-018d217d5877 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:55.841688 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-1fc79273-a4cd-4771-81a8-018d217d5877 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:55.850321 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1fc79273-a4cd-4771-81a8-018d217d5877 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:55.851087 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1fc79273-a4cd-4771-81a8-018d217d5877 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:55.852055 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1fc79273-a4cd-4771-81a8-018d217d5877 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:55.852788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1fc79273-a4cd-4771-81a8-018d217d5877 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:55.854323 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-275133a8-9e66-44cc-a63e-2efe9dc86110 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:55.864465 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-275133a8-9e66-44cc-a63e-2efe9dc86110 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:55.872634 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-275133a8-9e66-44cc-a63e-2efe9dc86110 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:55.874850 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-275133a8-9e66-44cc-a63e-2efe9dc86110 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:55.875779 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-275133a8-9e66-44cc-a63e-2efe9dc86110 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:55.878237 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-275133a8-9e66-44cc-a63e-2efe9dc86110 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:55.931371 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-1fc79273-a4cd-4771-81a8-018d217d5877 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:55.939707 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-1fc79273-a4cd-4771-81a8-018d217d5877 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc" status: 200 len: 1606 microversion: 2.1 time: 0.105748 Jun 27 18:51:55.940426 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 397/775] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:55 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc => generated 1606 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:51:56.036536 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-275133a8-9e66-44cc-a63e-2efe9dc86110 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:56.044359 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-275133a8-9e66-44cc-a63e-2efe9dc86110 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1569 microversion: 2.1 time: 0.194968 Jun 27 18:51:56.045045 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 379/776] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:55 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:51:56.154722 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-db7a4552-a29f-4184-8863-7b3ccbd6ff2c req-43a2d241-e475-4e12-8471-878f3da113c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47f70d2d-989d-4644-89db-b4b37d5f07cc", "name": "network-vif-deleted", "tag": "d9223b96-8c39-4c3a-a80d-f66b6e2f7c0c"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:51:56.164004 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-db7a4552-a29f-4184-8863-7b3ccbd6ff2c req-43a2d241-e475-4e12-8471-878f3da113c8 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:56.164705 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-db7a4552-a29f-4184-8863-7b3ccbd6ff2c req-43a2d241-e475-4e12-8471-878f3da113c8 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:56.176973 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-db7a4552-a29f-4184-8863-7b3ccbd6ff2c req-43a2d241-e475-4e12-8471-878f3da113c8 service nova] Creating event network-vif-deleted:d9223b96-8c39-4c3a-a80d-f66b6e2f7c0c for instance 47f70d2d-989d-4644-89db-b4b37d5f07cc on hv-cinder-84460 Jun 27 18:51:56.183169 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-db7a4552-a29f-4184-8863-7b3ccbd6ff2c req-43a2d241-e475-4e12-8471-878f3da113c8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032237 Jun 27 18:51:56.183959 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 398/777] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:51:56.957701 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-86366904-093d-43b7-9004-c344aec1279d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:56.958492 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-86366904-093d-43b7-9004-c344aec1279d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:56.967348 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-86366904-093d-43b7-9004-c344aec1279d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:56.971914 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-86366904-093d-43b7-9004-c344aec1279d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:56.974088 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-86366904-093d-43b7-9004-c344aec1279d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:56.974088 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-86366904-093d-43b7-9004-c344aec1279d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:57.015987 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:57.018024 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-86366904-093d-43b7-9004-c344aec1279d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:57.018931 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-86366904-093d-43b7-9004-c344aec1279d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:57.023773 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.objects.instance [None req-86366904-093d-43b7-9004-c344aec1279d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lazy-loading 'fault' on Instance uuid 47f70d2d-989d-4644-89db-b4b37d5f07cc {{(pid=124717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:51:57.061763 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-860c023e-2b08-45f5-b661-2152c1bc7e87 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:57.063086 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-860c023e-2b08-45f5-b661-2152c1bc7e87 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:57.070401 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-860c023e-2b08-45f5-b661-2152c1bc7e87 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:57.071312 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-860c023e-2b08-45f5-b661-2152c1bc7e87 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:57.072308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-860c023e-2b08-45f5-b661-2152c1bc7e87 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:57.072765 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-860c023e-2b08-45f5-b661-2152c1bc7e87 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:57.081438 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-86366904-093d-43b7-9004-c344aec1279d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6711e48be4d4ab33695e06c7227ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f19df10a9c948ce9c2e0dfa29532e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:57.089710 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-86366904-093d-43b7-9004-c344aec1279d tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc" status: 200 len: 1328 microversion: 2.1 time: 0.136149 Jun 27 18:51:57.090680 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 380/778] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:56 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc => generated 1328 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:51:57.227879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-860c023e-2b08-45f5-b661-2152c1bc7e87 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:57.235516 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-860c023e-2b08-45f5-b661-2152c1bc7e87 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1569 microversion: 2.1 time: 0.178086 Jun 27 18:51:57.236080 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 399/779] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:57 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:51:58.107698 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-118aeec8-ce55-4223-8de3-c343717f666e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:58.108317 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-118aeec8-ce55-4223-8de3-c343717f666e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:58.115286 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-118aeec8-ce55-4223-8de3-c343717f666e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:58.115986 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-118aeec8-ce55-4223-8de3-c343717f666e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:58.117414 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-118aeec8-ce55-4223-8de3-c343717f666e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:58.117944 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-118aeec8-ce55-4223-8de3-c343717f666e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:58.133194 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-118aeec8-ce55-4223-8de3-c343717f666e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] HTTP exception thrown: Instance 47f70d2d-989d-4644-89db-b4b37d5f07cc could not be found. Jun 27 18:51:58.135025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-118aeec8-ce55-4223-8de3-c343717f666e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Request method failure captured: Jun 27 18:51:58.135025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc HTTP/1.1 Jun 27 18:51:58.135025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 18:51:58.135025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 18:51:58.135025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 18:51:58.135025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 0 Jun 27 18:51:58.135025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 18:51:58.135025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 18:51:58.135025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 18:51:58.135025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 18:51:58.135025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufq5gWfZ1Ea8zegAT-oJvN8zf-eLgIVj0uveSKc2BH8nRZrEcnp7ZSOksWqIFeUNFAnR50wp1kDgWmv5crZ9FgowyJm7wrpmLRDruSxUmPUZD5sZkyfYtAilb0PpvFpZ_emCy2snXQeCB_QprvrsSewmqkWZqT8KA2R4gEq0FdwgOvI Jun 27 18:51:58.135025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 18:51:58.135025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 18:51:58.135025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 18:51:58.135025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 18:51:58.135025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 18:51:58.135025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 18:51:58.135025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: 0f19df10a9c948ce9c2e0dfa29532e5a Jun 27 18:51:58.135025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-AttachVolumeTestJSON-680751178 Jun 27 18:51:58.135025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 18:51:58.135025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 18:51:58.137509 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f19df10a9c948ce9c2e0dfa29532e5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f19df10a9c948ce9c2e0dfa29532e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0f19df10a9c948ce9c2e0dfa29532e5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0f19df10a9c948ce9c2e0dfa29532e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:51:58.137509 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-AttachVolumeTestJSON-680751178 Jun 27 18:51:58.137509 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: 0f19df10a9c948ce9c2e0dfa29532e5a Jun 27 18:51:58.137509 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-AttachVolumeTestJSON-680751178 Jun 27 18:51:58.137509 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-AttachVolumeTestJSON-680751178-project Jun 27 18:51:58.137509 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 18:51:58.137509 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 18:51:58.137509 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: 2fc6711e48be4d4ab33695e06c7227ab Jun 27 18:51:58.137509 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-AttachVolumeTestJSON-680751178-project Jun 27 18:51:58.137509 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: > Jun 27 18:51:58.137509 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Instance 47f70d2d-989d-4644-89db-b4b37d5f07cc could not be found. Jun 27 18:51:58.137509 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'id': '47f70d2d-989d-4644-89db-b4b37d5f07cc'} Jun 27 18:51:58.138468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:51:58.138468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:51:58.138468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:51:58.138468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:51:58.138468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:51:58.138468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:51:58.138468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:51:58.138468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:51:58.138468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:51:58.138468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:51:58.138468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47f70d2d-989d-4644-89db-b4b37d5f07cc could not be found. Jun 27 18:51:58.138468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:51:58.138468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:51:58.138468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:51:58.138468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:51:58.138468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:51:58.138468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:51:58.138468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:51:58.138468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:51:58.138468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:51:58.140056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:51:58.140056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:51:58.140056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:51:58.140056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:51:58.140056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:51:58.140056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:51:58.140056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:51:58.140056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47f70d2d-989d-4644-89db-b4b37d5f07cc could not be found. Jun 27 18:51:58.140056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:51:58.140056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:51:58.140056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:51:58.140056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:51:58.140056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:51:58.140056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:51:58.140056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:51:58.140056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:51:58.140056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47f70d2d-989d-4644-89db-b4b37d5f07cc could not be found. Jun 27 18:51:58.140056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:51:58.141441 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-118aeec8-ce55-4223-8de3-c343717f666e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Returning 404 to user: Instance 47f70d2d-989d-4644-89db-b4b37d5f07cc could not be found. {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:51:58.141441 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-118aeec8-ce55-4223-8de3-c343717f666e tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc" status: 404 len: 111 microversion: 2.1 time: 0.032621 Jun 27 18:51:58.141441 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 381/780] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:58 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:51:58.145566 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-0ab11854-5f52-44e3-acbc-3044673c8423 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '.version_select at 0x7f700f6233a0>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:58.205628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-0ab11854-5f52-44e3-acbc-3044673c8423 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1615449974" status: 202 len: 0 microversion: 2.1 time: 0.064056 Jun 27 18:51:58.206329 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 400/781] 10.222.0.15 () {58 vars in 1220 bytes} [Mon Jun 27 18:51:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1615449974 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 18:51:58.253156 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-7352dd6c-9edf-4e11-9a61-9753edfd2dc0 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:58.253822 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-7352dd6c-9edf-4e11-9a61-9753edfd2dc0 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:58.261153 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7352dd6c-9edf-4e11-9a61-9753edfd2dc0 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:58.261597 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7352dd6c-9edf-4e11-9a61-9753edfd2dc0 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:58.262356 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7352dd6c-9edf-4e11-9a61-9753edfd2dc0 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:58.262812 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7352dd6c-9edf-4e11-9a61-9753edfd2dc0 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:58.426549 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-7352dd6c-9edf-4e11-9a61-9753edfd2dc0 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:58.434761 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-7352dd6c-9edf-4e11-9a61-9753edfd2dc0 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1569 microversion: 2.1 time: 0.185497 Jun 27 18:51:58.435330 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 382/782] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:58 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:51:59.452478 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-45009020-e6be-4bc8-951f-9c78d738080b tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:51:59.453093 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-45009020-e6be-4bc8-951f-9c78d738080b tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:51:59.459713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-45009020-e6be-4bc8-951f-9c78d738080b tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:59.460156 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-45009020-e6be-4bc8-951f-9c78d738080b tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:59.462043 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-45009020-e6be-4bc8-951f-9c78d738080b tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:51:59.462501 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-45009020-e6be-4bc8-951f-9c78d738080b tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:51:59.639349 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-45009020-e6be-4bc8-951f-9c78d738080b tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:51:59.646945 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-45009020-e6be-4bc8-951f-9c78d738080b tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1569 microversion: 2.1 time: 0.198832 Jun 27 18:51:59.647732 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 401/783] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:51:59 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:00.667297 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-1f087702-ed2f-4f58-96c5-e1953f512113 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:00.667297 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-1f087702-ed2f-4f58-96c5-e1953f512113 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:00.673269 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1f087702-ed2f-4f58-96c5-e1953f512113 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:00.673753 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1f087702-ed2f-4f58-96c5-e1953f512113 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:00.674545 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1f087702-ed2f-4f58-96c5-e1953f512113 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:00.674986 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1f087702-ed2f-4f58-96c5-e1953f512113 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:00.810715 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-1f087702-ed2f-4f58-96c5-e1953f512113 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:00.818152 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-1f087702-ed2f-4f58-96c5-e1953f512113 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1569 microversion: 2.1 time: 0.156880 Jun 27 18:52:00.818743 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 383/784] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:00 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:01.602938 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-e7bd1be6-bf4f-4cf7-9820-faf76b9c2723 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:01.603440 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-e7bd1be6-bf4f-4cf7-9820-faf76b9c2723 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:01.605578 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:01.610286 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e7bd1be6-bf4f-4cf7-9820-faf76b9c2723 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:01.610774 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e7bd1be6-bf4f-4cf7-9820-faf76b9c2723 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:01.611547 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e7bd1be6-bf4f-4cf7-9820-faf76b9c2723 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:01.611988 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e7bd1be6-bf4f-4cf7-9820-faf76b9c2723 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:01.626088 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-e7bd1be6-bf4f-4cf7-9820-faf76b9c2723 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] HTTP exception thrown: Instance 47f70d2d-989d-4644-89db-b4b37d5f07cc could not be found. Jun 27 18:52:01.627783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-e7bd1be6-bf4f-4cf7-9820-faf76b9c2723 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Request method failure captured: Jun 27 18:52:01.627783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: DELETE /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc HTTP/1.1 Jun 27 18:52:01.627783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:52:01.627783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:52:01.627783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:52:01.627783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:52:01.627783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:52:01.627783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:52:01.627783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:52:01.627783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:52:01.627783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufq5gWfZ1Ea8zegAT-oJvN8zf-eLgIVj0uveSKc2BH8nRZrEcnp7ZSOksWqIFeUNFAnR50wp1kDgWmv5crZ9FgowyJm7wrpmLRDruSxUmPUZD5sZkyfYtAilb0PpvFpZ_emCy2snXQeCB_QprvrsSewmqkWZqT8KA2R4gEq0FdwgOvI Jun 27 18:52:01.627783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:52:01.627783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:52:01.627783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:52:01.627783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:52:01.627783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:52:01.627783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:52:01.627783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: 0f19df10a9c948ce9c2e0dfa29532e5a Jun 27 18:52:01.627783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-AttachVolumeTestJSON-680751178 Jun 27 18:52:01.627783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:52:01.627783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:52:01.629311 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f19df10a9c948ce9c2e0dfa29532e5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f19df10a9c948ce9c2e0dfa29532e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0f19df10a9c948ce9c2e0dfa29532e5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0f19df10a9c948ce9c2e0dfa29532e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:52:01.629311 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-AttachVolumeTestJSON-680751178 Jun 27 18:52:01.629311 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: 0f19df10a9c948ce9c2e0dfa29532e5a Jun 27 18:52:01.629311 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-AttachVolumeTestJSON-680751178 Jun 27 18:52:01.629311 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-AttachVolumeTestJSON-680751178-project Jun 27 18:52:01.629311 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:52:01.629311 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:52:01.629311 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: 2fc6711e48be4d4ab33695e06c7227ab Jun 27 18:52:01.629311 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-AttachVolumeTestJSON-680751178-project Jun 27 18:52:01.629311 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: > Jun 27 18:52:01.629311 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Instance 47f70d2d-989d-4644-89db-b4b37d5f07cc could not be found. Jun 27 18:52:01.629311 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': '47f70d2d-989d-4644-89db-b4b37d5f07cc'} Jun 27 18:52:01.630194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:52:01.630194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:01.630194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:52:01.630194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:52:01.630194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:52:01.630194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:52:01.630194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:52:01.630194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:52:01.630194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:52:01.630194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:52:01.630194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47f70d2d-989d-4644-89db-b4b37d5f07cc could not be found. Jun 27 18:52:01.630194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:01.630194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:52:01.630194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:01.630194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:01.630194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:52:01.630194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:52:01.630194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:52:01.630194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:52:01.630194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:52:01.631713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:52:01.631713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 18:52:01.631713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 18:52:01.631713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 18:52:01.631713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 18:52:01.631713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:52:01.631713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:52:01.631713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:52:01.631713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:52:01.631713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47f70d2d-989d-4644-89db-b4b37d5f07cc could not be found. Jun 27 18:52:01.631713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:01.631713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:52:01.631713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:01.631713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:01.631713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:52:01.631713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:52:01.631713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:52:01.631713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:52:01.631713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47f70d2d-989d-4644-89db-b4b37d5f07cc could not be found. Jun 27 18:52:01.631713 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:01.633785 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-e7bd1be6-bf4f-4cf7-9820-faf76b9c2723 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Returning 404 to user: Instance 47f70d2d-989d-4644-89db-b4b37d5f07cc could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:52:01.633785 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-e7bd1be6-bf4f-4cf7-9820-faf76b9c2723 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "DELETE /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc" status: 404 len: 111 microversion: 2.1 time: 0.030265 Jun 27 18:52:01.633785 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 402/785] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:52:01 2022] DELETE /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:52:01.638733 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a35e9255-06ce-4b2d-ba4d-58ec6ebcaa00 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:01.639358 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-a35e9255-06ce-4b2d-ba4d-58ec6ebcaa00 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: 47f70d2d-989d-4644-89db-b4b37d5f07cc] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:01.645582 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a35e9255-06ce-4b2d-ba4d-58ec6ebcaa00 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:01.646035 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a35e9255-06ce-4b2d-ba4d-58ec6ebcaa00 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:01.646879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a35e9255-06ce-4b2d-ba4d-58ec6ebcaa00 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:01.653502 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a35e9255-06ce-4b2d-ba4d-58ec6ebcaa00 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:01.660903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-a35e9255-06ce-4b2d-ba4d-58ec6ebcaa00 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] HTTP exception thrown: Instance 47f70d2d-989d-4644-89db-b4b37d5f07cc could not be found. Jun 27 18:52:01.662457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a35e9255-06ce-4b2d-ba4d-58ec6ebcaa00 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Request method failure captured: Jun 27 18:52:01.662457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc HTTP/1.1 Jun 27 18:52:01.662457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 18:52:01.662457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 18:52:01.662457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 18:52:01.662457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 0 Jun 27 18:52:01.662457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 18:52:01.662457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 18:52:01.662457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 18:52:01.662457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 18:52:01.662457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufq5gWfZ1Ea8zegAT-oJvN8zf-eLgIVj0uveSKc2BH8nRZrEcnp7ZSOksWqIFeUNFAnR50wp1kDgWmv5crZ9FgowyJm7wrpmLRDruSxUmPUZD5sZkyfYtAilb0PpvFpZ_emCy2snXQeCB_QprvrsSewmqkWZqT8KA2R4gEq0FdwgOvI Jun 27 18:52:01.662457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 18:52:01.662457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 18:52:01.662457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 18:52:01.662457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 18:52:01.662457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 18:52:01.662457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 18:52:01.662457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: 0f19df10a9c948ce9c2e0dfa29532e5a Jun 27 18:52:01.662457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-AttachVolumeTestJSON-680751178 Jun 27 18:52:01.662457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 18:52:01.662457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 18:52:01.664561 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f19df10a9c948ce9c2e0dfa29532e5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f19df10a9c948ce9c2e0dfa29532e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0f19df10a9c948ce9c2e0dfa29532e5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0f19df10a9c948ce9c2e0dfa29532e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:52:01.664561 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-AttachVolumeTestJSON-680751178 Jun 27 18:52:01.664561 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: 0f19df10a9c948ce9c2e0dfa29532e5a Jun 27 18:52:01.664561 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-AttachVolumeTestJSON-680751178 Jun 27 18:52:01.664561 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-AttachVolumeTestJSON-680751178-project Jun 27 18:52:01.664561 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 18:52:01.664561 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 18:52:01.664561 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: 2fc6711e48be4d4ab33695e06c7227ab Jun 27 18:52:01.664561 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-AttachVolumeTestJSON-680751178-project Jun 27 18:52:01.664561 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: > Jun 27 18:52:01.664561 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Instance 47f70d2d-989d-4644-89db-b4b37d5f07cc could not be found. Jun 27 18:52:01.664561 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'id': '47f70d2d-989d-4644-89db-b4b37d5f07cc'} Jun 27 18:52:01.665390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:52:01.665390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:01.665390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:52:01.665390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:52:01.665390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:52:01.665390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:52:01.665390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:52:01.665390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:52:01.665390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:52:01.665390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:52:01.665390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47f70d2d-989d-4644-89db-b4b37d5f07cc could not be found. Jun 27 18:52:01.665390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:01.665390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:52:01.665390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:01.665390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:01.665390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:52:01.665390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:52:01.665390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:52:01.665390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:52:01.665390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:52:01.666706 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:52:01.666706 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:52:01.666706 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:52:01.666706 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:52:01.666706 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:52:01.666706 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:52:01.666706 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:52:01.666706 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47f70d2d-989d-4644-89db-b4b37d5f07cc could not be found. Jun 27 18:52:01.666706 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:01.666706 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:52:01.666706 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:01.666706 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:01.666706 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:52:01.666706 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:52:01.666706 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:52:01.666706 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:52:01.666706 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47f70d2d-989d-4644-89db-b4b37d5f07cc could not be found. Jun 27 18:52:01.666706 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:01.668665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a35e9255-06ce-4b2d-ba4d-58ec6ebcaa00 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Returning 404 to user: Instance 47f70d2d-989d-4644-89db-b4b37d5f07cc could not be found. {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:52:01.668665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-a35e9255-06ce-4b2d-ba4d-58ec6ebcaa00 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc" status: 404 len: 111 microversion: 2.1 time: 0.029061 Jun 27 18:52:01.668665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 384/786] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:01 2022] GET /compute/v2.1/servers/47f70d2d-989d-4644-89db-b4b37d5f07cc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:52:01.836134 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-68ae2688-7703-418d-8cc3-eee881c4d205 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:01.836753 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-68ae2688-7703-418d-8cc3-eee881c4d205 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:01.843315 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-68ae2688-7703-418d-8cc3-eee881c4d205 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:01.843763 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-68ae2688-7703-418d-8cc3-eee881c4d205 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:01.844531 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-68ae2688-7703-418d-8cc3-eee881c4d205 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:01.844969 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-68ae2688-7703-418d-8cc3-eee881c4d205 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:01.997562 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-68ae2688-7703-418d-8cc3-eee881c4d205 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:02.005250 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-68ae2688-7703-418d-8cc3-eee881c4d205 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1569 microversion: 2.1 time: 0.172912 Jun 27 18:52:02.007302 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 403/787] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:01 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:02.950094 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-884475bd-eb89-48c3-a846-1de16e89ca06 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:02.950676 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-884475bd-eb89-48c3-a846-1de16e89ca06 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:02.957036 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-884475bd-eb89-48c3-a846-1de16e89ca06 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:02.957484 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-884475bd-eb89-48c3-a846-1de16e89ca06 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:02.958247 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-884475bd-eb89-48c3-a846-1de16e89ca06 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:02.958718 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-884475bd-eb89-48c3-a846-1de16e89ca06 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:02.972069 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-884475bd-eb89-48c3-a846-1de16e89ca06 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] HTTP exception thrown: Instance bd4240ca-4c5b-441f-b4f3-659defed4c91 could not be found. Jun 27 18:52:02.973609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-884475bd-eb89-48c3-a846-1de16e89ca06 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Request method failure captured: Jun 27 18:52:02.973609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: DELETE /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 HTTP/1.1 Jun 27 18:52:02.973609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 18:52:02.973609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 18:52:02.973609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 18:52:02.973609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 0 Jun 27 18:52:02.973609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 18:52:02.973609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 18:52:02.973609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 18:52:02.973609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 18:52:02.973609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufq5gWfZ1Ea8zegAT-oJvN8zf-eLgIVj0uveSKc2BH8nRZrEcnp7ZSOksWqIFeUNFAnR50wp1kDgWmv5crZ9FgowyJm7wrpmLRDruSxUmPUZD5sZkyfYtAilb0PpvFpZ_emCy2snXQeCB_QprvrsSewmqkWZqT8KA2R4gEq0FdwgOvI Jun 27 18:52:02.973609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 18:52:02.973609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 18:52:02.973609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 18:52:02.973609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 18:52:02.973609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 18:52:02.973609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 18:52:02.973609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: 0f19df10a9c948ce9c2e0dfa29532e5a Jun 27 18:52:02.973609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-AttachVolumeTestJSON-680751178 Jun 27 18:52:02.973609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 18:52:02.973609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 18:52:02.975169 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f19df10a9c948ce9c2e0dfa29532e5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f19df10a9c948ce9c2e0dfa29532e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0f19df10a9c948ce9c2e0dfa29532e5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0f19df10a9c948ce9c2e0dfa29532e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:52:02.975169 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-AttachVolumeTestJSON-680751178 Jun 27 18:52:02.975169 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: 0f19df10a9c948ce9c2e0dfa29532e5a Jun 27 18:52:02.975169 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-AttachVolumeTestJSON-680751178 Jun 27 18:52:02.975169 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-AttachVolumeTestJSON-680751178-project Jun 27 18:52:02.975169 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 18:52:02.975169 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 18:52:02.975169 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: 2fc6711e48be4d4ab33695e06c7227ab Jun 27 18:52:02.975169 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-AttachVolumeTestJSON-680751178-project Jun 27 18:52:02.975169 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: > Jun 27 18:52:02.975169 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Instance bd4240ca-4c5b-441f-b4f3-659defed4c91 could not be found. Jun 27 18:52:02.975169 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'id': 'bd4240ca-4c5b-441f-b4f3-659defed4c91'} Jun 27 18:52:02.976116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:52:02.976116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:02.976116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:52:02.976116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:52:02.976116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:52:02.976116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:52:02.976116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:52:02.976116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:52:02.976116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:52:02.976116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:52:02.976116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd4240ca-4c5b-441f-b4f3-659defed4c91 could not be found. Jun 27 18:52:02.976116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:02.976116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:52:02.976116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:02.976116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:02.976116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:52:02.976116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:52:02.976116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:52:02.976116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:52:02.976116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:52:02.977973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:52:02.977973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 18:52:02.977973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 18:52:02.977973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 18:52:02.977973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 18:52:02.977973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:52:02.977973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:52:02.977973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:52:02.977973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:52:02.977973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd4240ca-4c5b-441f-b4f3-659defed4c91 could not be found. Jun 27 18:52:02.977973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:02.977973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:52:02.977973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:02.977973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:02.977973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:52:02.977973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:52:02.977973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:52:02.977973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:52:02.977973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd4240ca-4c5b-441f-b4f3-659defed4c91 could not be found. Jun 27 18:52:02.977973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:02.979362 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-884475bd-eb89-48c3-a846-1de16e89ca06 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Returning 404 to user: Instance bd4240ca-4c5b-441f-b4f3-659defed4c91 could not be found. {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:52:02.979362 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-884475bd-eb89-48c3-a846-1de16e89ca06 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 404 len: 111 microversion: 2.1 time: 0.028901 Jun 27 18:52:02.979362 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 385/788] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:52:02 2022] DELETE /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:52:02.985050 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-018cfb1e-9543-4c84-80c2-23df8fb2e7c8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:02.985729 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-018cfb1e-9543-4c84-80c2-23df8fb2e7c8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] [instance: bd4240ca-4c5b-441f-b4f3-659defed4c91] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:02.992940 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-018cfb1e-9543-4c84-80c2-23df8fb2e7c8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:02.993393 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-018cfb1e-9543-4c84-80c2-23df8fb2e7c8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:02.994192 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-018cfb1e-9543-4c84-80c2-23df8fb2e7c8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:02.994654 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-018cfb1e-9543-4c84-80c2-23df8fb2e7c8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:03.008359 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-018cfb1e-9543-4c84-80c2-23df8fb2e7c8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] HTTP exception thrown: Instance bd4240ca-4c5b-441f-b4f3-659defed4c91 could not be found. Jun 27 18:52:03.009879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-018cfb1e-9543-4c84-80c2-23df8fb2e7c8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Request method failure captured: Jun 27 18:52:03.009879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 HTTP/1.1 Jun 27 18:52:03.009879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:52:03.009879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:52:03.009879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:52:03.009879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:52:03.009879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:52:03.009879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:52:03.009879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:52:03.009879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:52:03.009879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufq5gWfZ1Ea8zegAT-oJvN8zf-eLgIVj0uveSKc2BH8nRZrEcnp7ZSOksWqIFeUNFAnR50wp1kDgWmv5crZ9FgowyJm7wrpmLRDruSxUmPUZD5sZkyfYtAilb0PpvFpZ_emCy2snXQeCB_QprvrsSewmqkWZqT8KA2R4gEq0FdwgOvI Jun 27 18:52:03.009879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:52:03.009879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:52:03.009879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:52:03.009879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:52:03.009879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:52:03.009879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:52:03.009879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: 0f19df10a9c948ce9c2e0dfa29532e5a Jun 27 18:52:03.009879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-AttachVolumeTestJSON-680751178 Jun 27 18:52:03.009879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:52:03.009879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:52:03.011539 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f19df10a9c948ce9c2e0dfa29532e5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f19df10a9c948ce9c2e0dfa29532e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0f19df10a9c948ce9c2e0dfa29532e5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0f19df10a9c948ce9c2e0dfa29532e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:52:03.011539 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-AttachVolumeTestJSON-680751178 Jun 27 18:52:03.011539 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: 0f19df10a9c948ce9c2e0dfa29532e5a Jun 27 18:52:03.011539 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-AttachVolumeTestJSON-680751178 Jun 27 18:52:03.011539 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-AttachVolumeTestJSON-680751178-project Jun 27 18:52:03.011539 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:52:03.011539 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:52:03.011539 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: 2fc6711e48be4d4ab33695e06c7227ab Jun 27 18:52:03.011539 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-AttachVolumeTestJSON-680751178-project Jun 27 18:52:03.011539 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: > Jun 27 18:52:03.011539 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Instance bd4240ca-4c5b-441f-b4f3-659defed4c91 could not be found. Jun 27 18:52:03.011539 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': 'bd4240ca-4c5b-441f-b4f3-659defed4c91'} Jun 27 18:52:03.012354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:52:03.012354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:03.012354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:52:03.012354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:52:03.012354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:52:03.012354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:52:03.012354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:52:03.012354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:52:03.012354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:52:03.012354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:52:03.012354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd4240ca-4c5b-441f-b4f3-659defed4c91 could not be found. Jun 27 18:52:03.012354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:03.012354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:52:03.012354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:03.012354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:03.012354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:52:03.012354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:52:03.012354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:52:03.012354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:52:03.012354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:52:03.013771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:52:03.013771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:52:03.013771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:52:03.013771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:52:03.013771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:52:03.013771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:52:03.013771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:52:03.013771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd4240ca-4c5b-441f-b4f3-659defed4c91 could not be found. Jun 27 18:52:03.013771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:03.013771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:52:03.013771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:03.013771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:03.013771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:52:03.013771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:52:03.013771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:52:03.013771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:52:03.013771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd4240ca-4c5b-441f-b4f3-659defed4c91 could not be found. Jun 27 18:52:03.013771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:03.015036 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-018cfb1e-9543-4c84-80c2-23df8fb2e7c8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] Returning 404 to user: Instance bd4240ca-4c5b-441f-b4f3-659defed4c91 could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:52:03.015036 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-018cfb1e-9543-4c84-80c2-23df8fb2e7c8 tempest-AttachVolumeTestJSON-680751178 tempest-AttachVolumeTestJSON-680751178-project] 10.222.0.15 "GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91" status: 404 len: 111 microversion: 2.1 time: 0.030056 Jun 27 18:52:03.015036 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 404/789] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:02 2022] GET /compute/v2.1/servers/bd4240ca-4c5b-441f-b4f3-659defed4c91 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:52:03.022643 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-1cc8ce35-c6fd-46a8-9e83-8449f4f53f82 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:03.023326 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-1cc8ce35-c6fd-46a8-9e83-8449f4f53f82 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:03.030270 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1cc8ce35-c6fd-46a8-9e83-8449f4f53f82 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:03.030270 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1cc8ce35-c6fd-46a8-9e83-8449f4f53f82 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:03.038254 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1cc8ce35-c6fd-46a8-9e83-8449f4f53f82 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:03.038254 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1cc8ce35-c6fd-46a8-9e83-8449f4f53f82 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:03.166876 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-1cc8ce35-c6fd-46a8-9e83-8449f4f53f82 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:03.174773 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-1cc8ce35-c6fd-46a8-9e83-8449f4f53f82 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1569 microversion: 2.1 time: 0.156101 Jun 27 18:52:03.175409 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 386/790] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:03 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:04.192024 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-0d68d9be-e4b2-4a7a-9141-f8a44a2b7ed6 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:04.192682 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-0d68d9be-e4b2-4a7a-9141-f8a44a2b7ed6 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:04.202629 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0d68d9be-e4b2-4a7a-9141-f8a44a2b7ed6 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:04.207822 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0d68d9be-e4b2-4a7a-9141-f8a44a2b7ed6 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:04.207822 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0d68d9be-e4b2-4a7a-9141-f8a44a2b7ed6 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:04.207822 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0d68d9be-e4b2-4a7a-9141-f8a44a2b7ed6 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:04.441200 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-0d68d9be-e4b2-4a7a-9141-f8a44a2b7ed6 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:04.449208 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-0d68d9be-e4b2-4a7a-9141-f8a44a2b7ed6 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1569 microversion: 2.1 time: 0.261066 Jun 27 18:52:04.449869 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 405/791] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:04 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1569 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:05.468077 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-dcb35eb9-ab02-45fd-813e-127665ed4b5a tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:05.470176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-dcb35eb9-ab02-45fd-813e-127665ed4b5a tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:05.479549 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-dcb35eb9-ab02-45fd-813e-127665ed4b5a tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:05.480145 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-dcb35eb9-ab02-45fd-813e-127665ed4b5a tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:05.480921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-dcb35eb9-ab02-45fd-813e-127665ed4b5a tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:05.481355 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-dcb35eb9-ab02-45fd-813e-127665ed4b5a tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:05.738676 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-dcb35eb9-ab02-45fd-813e-127665ed4b5a tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:05.751128 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-dcb35eb9-ab02-45fd-813e-127665ed4b5a tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1569 microversion: 2.1 time: 0.289297 Jun 27 18:52:05.752139 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 387/792] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:05 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1569 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:06.769139 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-46a3e78a-87a7-4cf5-8528-397d8f992b3e tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:06.770562 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-46a3e78a-87a7-4cf5-8528-397d8f992b3e tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:06.777231 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-46a3e78a-87a7-4cf5-8528-397d8f992b3e tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:06.777722 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-46a3e78a-87a7-4cf5-8528-397d8f992b3e tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:06.778522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-46a3e78a-87a7-4cf5-8528-397d8f992b3e tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:06.779062 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-46a3e78a-87a7-4cf5-8528-397d8f992b3e tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:06.783113 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:06.934662 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-46a3e78a-87a7-4cf5-8528-397d8f992b3e tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:06.942106 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-46a3e78a-87a7-4cf5-8528-397d8f992b3e tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1569 microversion: 2.1 time: 0.177023 Jun 27 18:52:06.942937 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 406/793] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:06 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:07.959398 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-296b1051-b7b5-4407-9072-c4be78ba19e4 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:07.960021 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-296b1051-b7b5-4407-9072-c4be78ba19e4 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:07.967305 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-296b1051-b7b5-4407-9072-c4be78ba19e4 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:07.967851 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-296b1051-b7b5-4407-9072-c4be78ba19e4 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:07.968658 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-296b1051-b7b5-4407-9072-c4be78ba19e4 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:07.969093 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-296b1051-b7b5-4407-9072-c4be78ba19e4 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:08.104426 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-296b1051-b7b5-4407-9072-c4be78ba19e4 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:08.112060 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-296b1051-b7b5-4407-9072-c4be78ba19e4 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1569 microversion: 2.1 time: 0.156555 Jun 27 18:52:08.112629 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 388/794] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:07 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:08.670188 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-6c41a368-f8e1-4c0e-b2eb-9ca49ea06882 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:08.671318 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-6c41a368-f8e1-4c0e-b2eb-9ca49ea06882 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:08.678590 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6c41a368-f8e1-4c0e-b2eb-9ca49ea06882 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:08.679052 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6c41a368-f8e1-4c0e-b2eb-9ca49ea06882 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:08.679824 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6c41a368-f8e1-4c0e-b2eb-9ca49ea06882 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:08.680937 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6c41a368-f8e1-4c0e-b2eb-9ca49ea06882 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:08.710332 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-6c41a368-f8e1-4c0e-b2eb-9ca49ea06882 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044663 Jun 27 18:52:08.710919 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 407/795] 10.222.0.15 () {60 vars in 1342 bytes} [Mon Jun 27 18:52:08 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:52:08.777972 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-381aac68-9ff6-4ca7-88f9-84b58e845ae9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:08.778748 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-381aac68-9ff6-4ca7-88f9-84b58e845ae9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:08.785313 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-381aac68-9ff6-4ca7-88f9-84b58e845ae9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:08.785855 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-381aac68-9ff6-4ca7-88f9-84b58e845ae9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:08.786747 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-381aac68-9ff6-4ca7-88f9-84b58e845ae9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:08.787189 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-381aac68-9ff6-4ca7-88f9-84b58e845ae9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:08.812886 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-381aac68-9ff6-4ca7-88f9-84b58e845ae9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Going to try to terminate instance {{(pid=124717) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 18:52:09.068027 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-381aac68-9ff6-4ca7-88f9-84b58e845ae9 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 204 len: 0 microversion: 2.20 time: 0.294146 Jun 27 18:52:09.068679 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 389/796] 10.222.0.15 () {60 vars in 1279 bytes} [Mon Jun 27 18:52:08 2022] DELETE /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 27 18:52:09.077295 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-d8ec257c-dfa9-46f9-a7b0-6f40f67aa104 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:09.078101 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-d8ec257c-dfa9-46f9-a7b0-6f40f67aa104 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:09.084651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d8ec257c-dfa9-46f9-a7b0-6f40f67aa104 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:09.084975 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d8ec257c-dfa9-46f9-a7b0-6f40f67aa104 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:09.086125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d8ec257c-dfa9-46f9-a7b0-6f40f67aa104 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:09.086921 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d8ec257c-dfa9-46f9-a7b0-6f40f67aa104 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:09.131028 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-3241b841-c6ef-4b99-927c-2207705f8dc4 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:09.131769 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-3241b841-c6ef-4b99-927c-2207705f8dc4 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:09.138626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3241b841-c6ef-4b99-927c-2207705f8dc4 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:09.139070 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3241b841-c6ef-4b99-927c-2207705f8dc4 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:09.139848 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3241b841-c6ef-4b99-927c-2207705f8dc4 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:09.140288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3241b841-c6ef-4b99-927c-2207705f8dc4 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:09.263712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-d8ec257c-dfa9-46f9-a7b0-6f40f67aa104 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:09.272302 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-d8ec257c-dfa9-46f9-a7b0-6f40f67aa104 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:09.273804 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-d8ec257c-dfa9-46f9-a7b0-6f40f67aa104 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:09.275544 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-d8ec257c-dfa9-46f9-a7b0-6f40f67aa104 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1720 microversion: 2.20 time: 0.202411 Jun 27 18:52:09.276120 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 408/797] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:52:09 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1720 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 18:52:09.309116 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-3241b841-c6ef-4b99-927c-2207705f8dc4 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:09.316675 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-3241b841-c6ef-4b99-927c-2207705f8dc4 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1569 microversion: 2.1 time: 0.190085 Jun 27 18:52:09.317234 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 390/798] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:09 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1569 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:52:10.294544 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-3afa0103-6970-45e9-9073-a8568fb52371 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:10.295182 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-3afa0103-6970-45e9-9073-a8568fb52371 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:10.301855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3afa0103-6970-45e9-9073-a8568fb52371 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:10.302355 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3afa0103-6970-45e9-9073-a8568fb52371 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:10.303142 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3afa0103-6970-45e9-9073-a8568fb52371 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:10.303584 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3afa0103-6970-45e9-9073-a8568fb52371 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:10.342774 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-f7169690-4471-412d-9fed-af610e2dcb73 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:10.342774 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-f7169690-4471-412d-9fed-af610e2dcb73 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:10.345366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f7169690-4471-412d-9fed-af610e2dcb73 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:10.345988 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f7169690-4471-412d-9fed-af610e2dcb73 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:10.346931 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f7169690-4471-412d-9fed-af610e2dcb73 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:10.347611 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f7169690-4471-412d-9fed-af610e2dcb73 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:10.518103 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3afa0103-6970-45e9-9073-a8568fb52371 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:10.530359 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3afa0103-6970-45e9-9073-a8568fb52371 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:10.531568 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3afa0103-6970-45e9-9073-a8568fb52371 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:10.532939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-3afa0103-6970-45e9-9073-a8568fb52371 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1720 microversion: 2.20 time: 0.243125 Jun 27 18:52:10.533511 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 409/799] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:52:10 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1720 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:52:10.580442 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-f7169690-4471-412d-9fed-af610e2dcb73 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:10.591782 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-f7169690-4471-412d-9fed-af610e2dcb73 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1569 microversion: 2.1 time: 0.261084 Jun 27 18:52:10.592362 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 391/800] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:10 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1569 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:52:11.359714 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-f3d0b198-5450-4706-a5b4-7e394ab45f4f req-8770f11c-b2d5-4e9c-a2f8-a307fd75fe3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed77686-7baf-499a-9104-4bfe284ad76b", "name": "network-vif-deleted", "tag": "c771ad0c-04e1-4dea-b13c-fbcf24ecd5ac"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:52:11.367042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-f3d0b198-5450-4706-a5b4-7e394ab45f4f req-8770f11c-b2d5-4e9c-a2f8-a307fd75fe3f service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:11.367482 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-f3d0b198-5450-4706-a5b4-7e394ab45f4f req-8770f11c-b2d5-4e9c-a2f8-a307fd75fe3f service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:11.379305 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-f3d0b198-5450-4706-a5b4-7e394ab45f4f req-8770f11c-b2d5-4e9c-a2f8-a307fd75fe3f service nova] Creating event network-vif-deleted:c771ad0c-04e1-4dea-b13c-fbcf24ecd5ac for instance 3ed77686-7baf-499a-9104-4bfe284ad76b on hv-cinder-84460 Jun 27 18:52:11.384909 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-f3d0b198-5450-4706-a5b4-7e394ab45f4f req-8770f11c-b2d5-4e9c-a2f8-a307fd75fe3f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030598 Jun 27 18:52:11.385543 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 410/801] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:52:11.551341 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-4033ad5a-6ddf-482f-9450-4bc2032b842f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:11.553209 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-4033ad5a-6ddf-482f-9450-4bc2032b842f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:11.569379 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4033ad5a-6ddf-482f-9450-4bc2032b842f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:11.569883 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4033ad5a-6ddf-482f-9450-4bc2032b842f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:11.570738 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4033ad5a-6ddf-482f-9450-4bc2032b842f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:11.571234 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4033ad5a-6ddf-482f-9450-4bc2032b842f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:11.610949 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-56d3677c-4576-45d8-b3a3-882fa561ba95 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:11.611819 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-56d3677c-4576-45d8-b3a3-882fa561ba95 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:11.630024 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-56d3677c-4576-45d8-b3a3-882fa561ba95 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:11.630858 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-56d3677c-4576-45d8-b3a3-882fa561ba95 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:11.632224 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-56d3677c-4576-45d8-b3a3-882fa561ba95 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:11.633549 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-56d3677c-4576-45d8-b3a3-882fa561ba95 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:11.672598 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-4033ad5a-6ddf-482f-9450-4bc2032b842f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:11.682017 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-4033ad5a-6ddf-482f-9450-4bc2032b842f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:11.683797 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-4033ad5a-6ddf-482f-9450-4bc2032b842f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d74ace9f674f0da40cb35f39d559c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ec901270bc4375b22fba22ed2ff68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:11.684980 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-4033ad5a-6ddf-482f-9450-4bc2032b842f tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 200 len: 1365 microversion: 2.20 time: 0.137620 Jun 27 18:52:11.685600 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 392/802] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:52:11 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 1365 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 18:52:11.838605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-56d3677c-4576-45d8-b3a3-882fa561ba95 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:11.855417 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-56d3677c-4576-45d8-b3a3-882fa561ba95 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1510 microversion: 2.1 time: 0.247813 Jun 27 18:52:11.855417 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 411/803] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:11 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1510 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:52:11.873324 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-5a5e4196-aacb-4f4d-b155-05e045dda97d tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:52:11.874220 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-5a5e4196-aacb-4f4d-b155-05e045dda97d tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:11.881144 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5a5e4196-aacb-4f4d-b155-05e045dda97d tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:11.881589 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5a5e4196-aacb-4f4d-b155-05e045dda97d tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:11.882716 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5a5e4196-aacb-4f4d-b155-05e045dda97d tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:11.882845 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5a5e4196-aacb-4f4d-b155-05e045dda97d tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:11.947560 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:12.064970 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-5a5e4196-aacb-4f4d-b155-05e045dda97d tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "POST /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239/action" status: 202 len: 0 microversion: 2.1 time: 0.198567 Jun 27 18:52:12.065954 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 393/804] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Jun 27 18:52:11 2022] POST /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 18:52:12.075699 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-95cd958e-1a34-4dd8-8bbb-d33eb1cadc31 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:12.079082 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-95cd958e-1a34-4dd8-8bbb-d33eb1cadc31 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:12.085297 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-95cd958e-1a34-4dd8-8bbb-d33eb1cadc31 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:12.090809 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-95cd958e-1a34-4dd8-8bbb-d33eb1cadc31 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:12.090809 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-95cd958e-1a34-4dd8-8bbb-d33eb1cadc31 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:12.090809 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-95cd958e-1a34-4dd8-8bbb-d33eb1cadc31 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:12.257582 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-95cd958e-1a34-4dd8-8bbb-d33eb1cadc31 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:12.265625 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-95cd958e-1a34-4dd8-8bbb-d33eb1cadc31 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1518 microversion: 2.1 time: 0.194666 Jun 27 18:52:12.266213 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 412/805] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:12 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1518 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:12.705376 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-53c0c254-fe25-4868-9e9d-a45a938480d6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:12.705924 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-53c0c254-fe25-4868-9e9d-a45a938480d6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:12.714152 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-53c0c254-fe25-4868-9e9d-a45a938480d6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:12.714872 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-53c0c254-fe25-4868-9e9d-a45a938480d6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:12.717204 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-53c0c254-fe25-4868-9e9d-a45a938480d6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:12.718908 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-53c0c254-fe25-4868-9e9d-a45a938480d6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:12.729348 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-9da0e8b6-d7a1-4983-9476-7a6e69cb153c req-af8ae9eb-2e52-4e5b-8608-52511627beb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a731689-b26b-4f41-a3d3-4d1a2ebff239", "name": "network-vif-unplugged", "status": "completed", "tag": "d446f8e5-97d8-434f-9b91-31d20061c950"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:52:12.744675 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-9da0e8b6-d7a1-4983-9476-7a6e69cb153c req-af8ae9eb-2e52-4e5b-8608-52511627beb5 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:12.749962 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-9da0e8b6-d7a1-4983-9476-7a6e69cb153c req-af8ae9eb-2e52-4e5b-8608-52511627beb5 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:12.756190 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-53c0c254-fe25-4868-9e9d-a45a938480d6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] HTTP exception thrown: Instance 3ed77686-7baf-499a-9104-4bfe284ad76b could not be found. Jun 27 18:52:12.760846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-53c0c254-fe25-4868-9e9d-a45a938480d6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Request method failure captured: Jun 27 18:52:12.760846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b HTTP/1.1 Jun 27 18:52:12.760846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 18:52:12.760846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 18:52:12.760846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 18:52:12.760846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 0 Jun 27 18:52:12.760846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 18:52:12.760846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 18:52:12.760846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 18:52:12.760846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 18:52:12.760846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufq_bpO0xE70bhp754i-ELyUiZpKCPBFqJlVJkEt-tcFB0NMYIR4AZGYNyJl81fEc_KQPzkNS1DYv7NGJBl5GQOXg1XLsM_rJL1zADgrZKZ7F5mORnC28fyA1LFbFTAv5ffwm2xW6YP1uSdtWWwxQXETpdKhC4Qec1EPagatsQXDf6E Jun 27 18:52:12.760846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 18:52:12.760846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 18:52:12.760846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 18:52:12.760846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 18:52:12.760846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 18:52:12.760846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 18:52:12.760846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 18:52:12.760846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: 80ec901270bc4375b22fba22ed2ff68c Jun 27 18:52:12.760846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-734361258 Jun 27 18:52:12.760846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 18:52:12.760846 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 18:52:12.762532 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/80ec901270bc4375b22fba22ed2ff68c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/80ec901270bc4375b22fba22ed2ff68c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_80ec901270bc4375b22fba22ed2ff68c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/80ec901270bc4375b22fba22ed2ff68c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:52:12.762532 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-AttachVolumeShelveTestJSON-734361258 Jun 27 18:52:12.762532 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: 80ec901270bc4375b22fba22ed2ff68c Jun 27 18:52:12.762532 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-734361258 Jun 27 18:52:12.762532 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-AttachVolumeShelveTestJSON-734361258-project Jun 27 18:52:12.762532 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 18:52:12.762532 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 18:52:12.762532 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: f6d74ace9f674f0da40cb35f39d559c9 Jun 27 18:52:12.762532 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-AttachVolumeShelveTestJSON-734361258-project Jun 27 18:52:12.762532 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: > Jun 27 18:52:12.762532 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Instance 3ed77686-7baf-499a-9104-4bfe284ad76b could not be found. Jun 27 18:52:12.762532 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'id': '3ed77686-7baf-499a-9104-4bfe284ad76b'} Jun 27 18:52:12.763562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:52:12.763562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:12.763562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:52:12.763562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:52:12.763562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:52:12.763562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:52:12.763562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:52:12.763562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:52:12.763562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:52:12.763562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:52:12.763562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ed77686-7baf-499a-9104-4bfe284ad76b could not be found. Jun 27 18:52:12.763562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:12.763562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:52:12.763562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:12.763562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:12.763562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:52:12.763562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:52:12.763562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:52:12.763562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:52:12.763562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:52:12.764805 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:52:12.764805 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:52:12.764805 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:52:12.764805 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:52:12.764805 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:52:12.764805 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:52:12.764805 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:52:12.764805 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ed77686-7baf-499a-9104-4bfe284ad76b could not be found. Jun 27 18:52:12.764805 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:12.764805 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:52:12.764805 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:12.764805 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:12.764805 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:52:12.764805 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:52:12.764805 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:52:12.764805 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:52:12.764805 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ed77686-7baf-499a-9104-4bfe284ad76b could not be found. Jun 27 18:52:12.764805 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:12.765881 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-53c0c254-fe25-4868-9e9d-a45a938480d6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Returning 404 to user: Instance 3ed77686-7baf-499a-9104-4bfe284ad76b could not be found. {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:52:12.765881 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-53c0c254-fe25-4868-9e9d-a45a938480d6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 404 len: 111 microversion: 2.20 time: 0.062673 Jun 27 18:52:12.776154 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 394/806] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:52:12 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 18:52:12.778954 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.compute.server_external_events [req-9da0e8b6-d7a1-4983-9476-7a6e69cb153c req-af8ae9eb-2e52-4e5b-8608-52511627beb5 service nova] Unable to find a host for instance 2a731689-b26b-4f41-a3d3-4d1a2ebff239. Dropping event network-vif-unplugged {{(pid=124716) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 27 18:52:12.780065 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-9da0e8b6-d7a1-4983-9476-7a6e69cb153c req-af8ae9eb-2e52-4e5b-8608-52511627beb5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.054707 Jun 27 18:52:12.780816 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 413/807] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 56 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 27 18:52:12.781064 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-c4083bc2-fc7a-4f91-a41c-d86bcda34986 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '.version_select at 0x7f700ff2f310>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:12.864167 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-c4083bc2-fc7a-4f91-a41c-d86bcda34986 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-112762027" status: 204 len: 0 microversion: 2.20 time: 0.086848 Jun 27 18:52:12.864888 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 395/808] 10.222.0.15 () {60 vars in 1258 bytes} [Mon Jun 27 18:52:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-112762027 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 27 18:52:13.282503 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-ea63fb33-4f72-4827-b72c-b7cc181a7ccb tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:13.283129 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-ea63fb33-4f72-4827-b72c-b7cc181a7ccb tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:13.306717 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ea63fb33-4f72-4827-b72c-b7cc181a7ccb tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:13.306717 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ea63fb33-4f72-4827-b72c-b7cc181a7ccb tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:13.306717 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ea63fb33-4f72-4827-b72c-b7cc181a7ccb tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:13.306717 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ea63fb33-4f72-4827-b72c-b7cc181a7ccb tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:13.531701 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-ea63fb33-4f72-4827-b72c-b7cc181a7ccb tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:13.539430 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-ea63fb33-4f72-4827-b72c-b7cc181a7ccb tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1520 microversion: 2.1 time: 0.260806 Jun 27 18:52:13.540625 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 414/809] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:13 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:14.559573 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-20d82e2e-9b1d-4d58-af53-037340a464e7 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:14.560202 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-20d82e2e-9b1d-4d58-af53-037340a464e7 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:14.571525 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-20d82e2e-9b1d-4d58-af53-037340a464e7 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:14.572087 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-20d82e2e-9b1d-4d58-af53-037340a464e7 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:14.573067 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-20d82e2e-9b1d-4d58-af53-037340a464e7 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:14.573521 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-20d82e2e-9b1d-4d58-af53-037340a464e7 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:14.719758 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-20d82e2e-9b1d-4d58-af53-037340a464e7 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:14.731097 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-20d82e2e-9b1d-4d58-af53-037340a464e7 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1576 microversion: 2.1 time: 0.175823 Jun 27 18:52:14.739187 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 396/810] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:14 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:15.113935 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-79183b6d-f23a-404f-afb2-ce84ee5c7336 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:15.115002 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-79183b6d-f23a-404f-afb2-ce84ee5c7336 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:15.124885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-79183b6d-f23a-404f-afb2-ce84ee5c7336 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:15.125523 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-79183b6d-f23a-404f-afb2-ce84ee5c7336 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:15.126900 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-79183b6d-f23a-404f-afb2-ce84ee5c7336 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:15.127491 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-79183b6d-f23a-404f-afb2-ce84ee5c7336 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:15.146821 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-79183b6d-f23a-404f-afb2-ce84ee5c7336 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] HTTP exception thrown: Instance 3ed77686-7baf-499a-9104-4bfe284ad76b could not be found. Jun 27 18:52:15.148522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-79183b6d-f23a-404f-afb2-ce84ee5c7336 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Request method failure captured: Jun 27 18:52:15.148522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: DELETE /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b HTTP/1.1 Jun 27 18:52:15.148522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:52:15.148522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:52:15.148522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:52:15.148522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:52:15.148522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:52:15.148522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:52:15.148522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:52:15.148522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:52:15.148522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufq_bpO0xE70bhp754i-ELyUiZpKCPBFqJlVJkEt-tcFB0NMYIR4AZGYNyJl81fEc_KQPzkNS1DYv7NGJBl5GQOXg1XLsM_rJL1zADgrZKZ7F5mORnC28fyA1LFbFTAv5ffwm2xW6YP1uSdtWWwxQXETpdKhC4Qec1EPagatsQXDf6E Jun 27 18:52:15.148522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:52:15.148522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:52:15.148522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:52:15.148522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:52:15.148522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 18:52:15.148522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:52:15.148522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:52:15.148522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: 80ec901270bc4375b22fba22ed2ff68c Jun 27 18:52:15.148522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-734361258 Jun 27 18:52:15.148522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:52:15.148522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:52:15.150123 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/80ec901270bc4375b22fba22ed2ff68c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/80ec901270bc4375b22fba22ed2ff68c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_80ec901270bc4375b22fba22ed2ff68c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/80ec901270bc4375b22fba22ed2ff68c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:52:15.150123 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-AttachVolumeShelveTestJSON-734361258 Jun 27 18:52:15.150123 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: 80ec901270bc4375b22fba22ed2ff68c Jun 27 18:52:15.150123 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-734361258 Jun 27 18:52:15.150123 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-AttachVolumeShelveTestJSON-734361258-project Jun 27 18:52:15.150123 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:52:15.150123 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:52:15.150123 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: f6d74ace9f674f0da40cb35f39d559c9 Jun 27 18:52:15.150123 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-AttachVolumeShelveTestJSON-734361258-project Jun 27 18:52:15.150123 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: > Jun 27 18:52:15.150123 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Instance 3ed77686-7baf-499a-9104-4bfe284ad76b could not be found. Jun 27 18:52:15.150123 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': '3ed77686-7baf-499a-9104-4bfe284ad76b'} Jun 27 18:52:15.151114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:52:15.151114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:15.151114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:52:15.151114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:52:15.151114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:52:15.151114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:52:15.151114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:52:15.151114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:52:15.151114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:52:15.151114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:52:15.151114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ed77686-7baf-499a-9104-4bfe284ad76b could not be found. Jun 27 18:52:15.151114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:15.151114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:52:15.151114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:15.151114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:15.151114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:52:15.151114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:52:15.151114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:52:15.151114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:52:15.151114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:52:15.152656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:52:15.152656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 18:52:15.152656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 18:52:15.152656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 18:52:15.152656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 18:52:15.152656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:52:15.152656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:52:15.152656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:52:15.152656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:52:15.152656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ed77686-7baf-499a-9104-4bfe284ad76b could not be found. Jun 27 18:52:15.152656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:15.152656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:52:15.152656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:15.152656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:15.152656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:52:15.152656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:52:15.152656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:52:15.152656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:52:15.152656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ed77686-7baf-499a-9104-4bfe284ad76b could not be found. Jun 27 18:52:15.152656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:15.154106 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-79183b6d-f23a-404f-afb2-ce84ee5c7336 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Returning 404 to user: Instance 3ed77686-7baf-499a-9104-4bfe284ad76b could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:52:15.154106 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-79183b6d-f23a-404f-afb2-ce84ee5c7336 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 404 len: 111 microversion: 2.20 time: 0.040640 Jun 27 18:52:15.154106 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 415/811] 10.222.0.15 () {60 vars in 1279 bytes} [Mon Jun 27 18:52:15 2022] DELETE /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 18:52:15.162508 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-f53cf3a4-e2a2-4d86-8373-00b3bd4049d6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:15.163415 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-f53cf3a4-e2a2-4d86-8373-00b3bd4049d6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 3ed77686-7baf-499a-9104-4bfe284ad76b] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:15.173214 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f53cf3a4-e2a2-4d86-8373-00b3bd4049d6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:15.173707 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f53cf3a4-e2a2-4d86-8373-00b3bd4049d6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:15.174590 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f53cf3a4-e2a2-4d86-8373-00b3bd4049d6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:15.175062 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f53cf3a4-e2a2-4d86-8373-00b3bd4049d6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:15.191807 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-f53cf3a4-e2a2-4d86-8373-00b3bd4049d6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] HTTP exception thrown: Instance 3ed77686-7baf-499a-9104-4bfe284ad76b could not be found. Jun 27 18:52:15.193413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-f53cf3a4-e2a2-4d86-8373-00b3bd4049d6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Request method failure captured: Jun 27 18:52:15.193413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b HTTP/1.1 Jun 27 18:52:15.193413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 18:52:15.193413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 18:52:15.193413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 18:52:15.193413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 0 Jun 27 18:52:15.193413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 18:52:15.193413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 18:52:15.193413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 18:52:15.193413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 18:52:15.193413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufq_bpO0xE70bhp754i-ELyUiZpKCPBFqJlVJkEt-tcFB0NMYIR4AZGYNyJl81fEc_KQPzkNS1DYv7NGJBl5GQOXg1XLsM_rJL1zADgrZKZ7F5mORnC28fyA1LFbFTAv5ffwm2xW6YP1uSdtWWwxQXETpdKhC4Qec1EPagatsQXDf6E Jun 27 18:52:15.193413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 18:52:15.193413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 18:52:15.193413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 18:52:15.193413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 18:52:15.193413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 18:52:15.193413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 18:52:15.193413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 18:52:15.193413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: 80ec901270bc4375b22fba22ed2ff68c Jun 27 18:52:15.193413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-734361258 Jun 27 18:52:15.193413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 18:52:15.193413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 18:52:15.195289 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/80ec901270bc4375b22fba22ed2ff68c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/80ec901270bc4375b22fba22ed2ff68c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_80ec901270bc4375b22fba22ed2ff68c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/80ec901270bc4375b22fba22ed2ff68c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:52:15.195289 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-AttachVolumeShelveTestJSON-734361258 Jun 27 18:52:15.195289 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: 80ec901270bc4375b22fba22ed2ff68c Jun 27 18:52:15.195289 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-734361258 Jun 27 18:52:15.195289 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-AttachVolumeShelveTestJSON-734361258-project Jun 27 18:52:15.195289 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 18:52:15.195289 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 18:52:15.195289 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: f6d74ace9f674f0da40cb35f39d559c9 Jun 27 18:52:15.195289 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-AttachVolumeShelveTestJSON-734361258-project Jun 27 18:52:15.195289 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: > Jun 27 18:52:15.195289 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Instance 3ed77686-7baf-499a-9104-4bfe284ad76b could not be found. Jun 27 18:52:15.195289 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'id': '3ed77686-7baf-499a-9104-4bfe284ad76b'} Jun 27 18:52:15.197042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:52:15.197042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:15.197042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:52:15.197042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:52:15.197042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:52:15.197042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:52:15.197042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:52:15.197042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:52:15.197042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:52:15.197042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:52:15.197042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ed77686-7baf-499a-9104-4bfe284ad76b could not be found. Jun 27 18:52:15.197042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:15.197042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:52:15.197042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:15.197042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:15.197042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:52:15.197042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:52:15.197042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:52:15.197042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:52:15.197042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:52:15.198445 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:52:15.198445 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:52:15.198445 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:52:15.198445 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:52:15.198445 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:52:15.198445 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:52:15.198445 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:52:15.198445 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ed77686-7baf-499a-9104-4bfe284ad76b could not be found. Jun 27 18:52:15.198445 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:15.198445 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:52:15.198445 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:15.198445 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:15.198445 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:52:15.198445 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:52:15.198445 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:52:15.198445 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:52:15.198445 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ed77686-7baf-499a-9104-4bfe284ad76b could not be found. Jun 27 18:52:15.198445 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:15.199897 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-f53cf3a4-e2a2-4d86-8373-00b3bd4049d6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Returning 404 to user: Instance 3ed77686-7baf-499a-9104-4bfe284ad76b could not be found. {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:52:15.199897 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-f53cf3a4-e2a2-4d86-8373-00b3bd4049d6 tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b" status: 404 len: 111 microversion: 2.20 time: 0.038231 Jun 27 18:52:15.199897 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 397/812] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:52:15 2022] GET /compute/v2.1/servers/3ed77686-7baf-499a-9104-4bfe284ad76b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 18:52:15.750190 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f1bb84ca-252e-435e-b76c-21b5579637df tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:15.750933 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f1bb84ca-252e-435e-b76c-21b5579637df tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:15.757710 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f1bb84ca-252e-435e-b76c-21b5579637df tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:15.758145 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f1bb84ca-252e-435e-b76c-21b5579637df tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:15.758997 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f1bb84ca-252e-435e-b76c-21b5579637df tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:15.759432 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f1bb84ca-252e-435e-b76c-21b5579637df tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:15.900933 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f1bb84ca-252e-435e-b76c-21b5579637df tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:15.908722 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f1bb84ca-252e-435e-b76c-21b5579637df tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1576 microversion: 2.1 time: 0.164718 Jun 27 18:52:15.909294 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 416/813] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:15 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:52:16.466904 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0da36faa-d535-4f39-92c9-fe353d5f836b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:16.467551 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-0da36faa-d535-4f39-92c9-fe353d5f836b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:16.473513 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0da36faa-d535-4f39-92c9-fe353d5f836b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:16.473963 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0da36faa-d535-4f39-92c9-fe353d5f836b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:16.474751 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0da36faa-d535-4f39-92c9-fe353d5f836b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:16.475214 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0da36faa-d535-4f39-92c9-fe353d5f836b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:16.489437 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-0da36faa-d535-4f39-92c9-fe353d5f836b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] HTTP exception thrown: Instance 91366512-6fa4-4a20-a867-94852749b02f could not be found. Jun 27 18:52:16.491048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0da36faa-d535-4f39-92c9-fe353d5f836b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Request method failure captured: Jun 27 18:52:16.491048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: DELETE /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f HTTP/1.1 Jun 27 18:52:16.491048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 18:52:16.491048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 18:52:16.491048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 18:52:16.491048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 0 Jun 27 18:52:16.491048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 18:52:16.491048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 18:52:16.491048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 18:52:16.491048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 18:52:16.491048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufq_bpO0xE70bhp754i-ELyUiZpKCPBFqJlVJkEt-tcFB0NMYIR4AZGYNyJl81fEc_KQPzkNS1DYv7NGJBl5GQOXg1XLsM_rJL1zADgrZKZ7F5mORnC28fyA1LFbFTAv5ffwm2xW6YP1uSdtWWwxQXETpdKhC4Qec1EPagatsQXDf6E Jun 27 18:52:16.491048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 18:52:16.491048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 18:52:16.491048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 18:52:16.491048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 18:52:16.491048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 18:52:16.491048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 18:52:16.491048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 18:52:16.491048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: 80ec901270bc4375b22fba22ed2ff68c Jun 27 18:52:16.491048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-734361258 Jun 27 18:52:16.491048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 18:52:16.491048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 18:52:16.493049 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/80ec901270bc4375b22fba22ed2ff68c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/80ec901270bc4375b22fba22ed2ff68c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_80ec901270bc4375b22fba22ed2ff68c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/80ec901270bc4375b22fba22ed2ff68c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:52:16.493049 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-AttachVolumeShelveTestJSON-734361258 Jun 27 18:52:16.493049 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: 80ec901270bc4375b22fba22ed2ff68c Jun 27 18:52:16.493049 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-734361258 Jun 27 18:52:16.493049 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-AttachVolumeShelveTestJSON-734361258-project Jun 27 18:52:16.493049 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 18:52:16.493049 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 18:52:16.493049 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: f6d74ace9f674f0da40cb35f39d559c9 Jun 27 18:52:16.493049 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-AttachVolumeShelveTestJSON-734361258-project Jun 27 18:52:16.493049 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: > Jun 27 18:52:16.493049 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Instance 91366512-6fa4-4a20-a867-94852749b02f could not be found. Jun 27 18:52:16.493049 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'id': '91366512-6fa4-4a20-a867-94852749b02f'} Jun 27 18:52:16.494262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:52:16.494262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:16.494262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:52:16.494262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:52:16.494262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:52:16.494262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:52:16.494262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:52:16.494262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:52:16.494262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:52:16.494262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:52:16.494262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91366512-6fa4-4a20-a867-94852749b02f could not be found. Jun 27 18:52:16.494262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:16.494262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:52:16.494262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:16.494262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:16.494262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:52:16.494262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:52:16.494262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:52:16.494262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:52:16.494262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:52:16.495495 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:52:16.495495 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 18:52:16.495495 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 18:52:16.495495 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 18:52:16.495495 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 18:52:16.495495 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:52:16.495495 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:52:16.495495 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:52:16.495495 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:52:16.495495 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91366512-6fa4-4a20-a867-94852749b02f could not be found. Jun 27 18:52:16.495495 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:16.495495 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:52:16.495495 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:16.495495 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:16.495495 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:52:16.495495 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:52:16.495495 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:52:16.495495 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:52:16.495495 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91366512-6fa4-4a20-a867-94852749b02f could not be found. Jun 27 18:52:16.495495 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:52:16.496694 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0da36faa-d535-4f39-92c9-fe353d5f836b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Returning 404 to user: Instance 91366512-6fa4-4a20-a867-94852749b02f could not be found. {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:52:16.496694 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-0da36faa-d535-4f39-92c9-fe353d5f836b tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "DELETE /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 404 len: 111 microversion: 2.20 time: 0.030190 Jun 27 18:52:16.496694 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 398/814] 10.222.0.15 () {60 vars in 1279 bytes} [Mon Jun 27 18:52:16 2022] DELETE /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 18:52:16.501314 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-9d0713bb-bf39-4f25-9bf4-2098fd62646a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:16.501940 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-9d0713bb-bf39-4f25-9bf4-2098fd62646a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] [instance: 91366512-6fa4-4a20-a867-94852749b02f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:16.508950 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9d0713bb-bf39-4f25-9bf4-2098fd62646a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:16.509696 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9d0713bb-bf39-4f25-9bf4-2098fd62646a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:16.510371 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9d0713bb-bf39-4f25-9bf4-2098fd62646a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:16.510833 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9d0713bb-bf39-4f25-9bf4-2098fd62646a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:16.525155 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-9d0713bb-bf39-4f25-9bf4-2098fd62646a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] HTTP exception thrown: Instance 91366512-6fa4-4a20-a867-94852749b02f could not be found. Jun 27 18:52:16.526727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-9d0713bb-bf39-4f25-9bf4-2098fd62646a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Request method failure captured: Jun 27 18:52:16.526727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f HTTP/1.1 Jun 27 18:52:16.526727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:52:16.526727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:52:16.526727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:52:16.526727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:52:16.526727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:52:16.526727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:52:16.526727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:52:16.526727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:52:16.526727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufq_bpO0xE70bhp754i-ELyUiZpKCPBFqJlVJkEt-tcFB0NMYIR4AZGYNyJl81fEc_KQPzkNS1DYv7NGJBl5GQOXg1XLsM_rJL1zADgrZKZ7F5mORnC28fyA1LFbFTAv5ffwm2xW6YP1uSdtWWwxQXETpdKhC4Qec1EPagatsQXDf6E Jun 27 18:52:16.526727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:52:16.526727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:52:16.526727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:52:16.526727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:52:16.526727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 18:52:16.526727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:52:16.526727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:52:16.526727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: 80ec901270bc4375b22fba22ed2ff68c Jun 27 18:52:16.526727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-734361258 Jun 27 18:52:16.526727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:52:16.526727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:52:16.528449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/80ec901270bc4375b22fba22ed2ff68c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/80ec901270bc4375b22fba22ed2ff68c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_80ec901270bc4375b22fba22ed2ff68c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/80ec901270bc4375b22fba22ed2ff68c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:52:16.528449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-AttachVolumeShelveTestJSON-734361258 Jun 27 18:52:16.528449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: 80ec901270bc4375b22fba22ed2ff68c Jun 27 18:52:16.528449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-734361258 Jun 27 18:52:16.528449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-AttachVolumeShelveTestJSON-734361258-project Jun 27 18:52:16.528449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:52:16.528449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:52:16.528449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: f6d74ace9f674f0da40cb35f39d559c9 Jun 27 18:52:16.528449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-AttachVolumeShelveTestJSON-734361258-project Jun 27 18:52:16.528449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: > Jun 27 18:52:16.528449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Instance 91366512-6fa4-4a20-a867-94852749b02f could not be found. Jun 27 18:52:16.528449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': '91366512-6fa4-4a20-a867-94852749b02f'} Jun 27 18:52:16.529274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:52:16.529274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:16.529274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:52:16.529274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:52:16.529274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:52:16.529274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:52:16.529274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:52:16.529274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:52:16.529274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:52:16.529274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:52:16.529274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91366512-6fa4-4a20-a867-94852749b02f could not be found. Jun 27 18:52:16.529274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:16.529274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:52:16.529274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:16.529274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:16.529274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:52:16.529274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:52:16.529274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:52:16.529274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:52:16.529274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:52:16.530784 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:52:16.530784 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:52:16.530784 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:52:16.530784 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:52:16.530784 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:52:16.530784 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:52:16.530784 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:52:16.530784 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91366512-6fa4-4a20-a867-94852749b02f could not be found. Jun 27 18:52:16.530784 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:16.530784 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:52:16.530784 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:16.530784 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:16.530784 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:52:16.530784 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:52:16.530784 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:52:16.530784 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:52:16.530784 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91366512-6fa4-4a20-a867-94852749b02f could not be found. Jun 27 18:52:16.530784 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:16.532112 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-9d0713bb-bf39-4f25-9bf4-2098fd62646a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] Returning 404 to user: Instance 91366512-6fa4-4a20-a867-94852749b02f could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:52:16.532112 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-9d0713bb-bf39-4f25-9bf4-2098fd62646a tempest-AttachVolumeShelveTestJSON-734361258 tempest-AttachVolumeShelveTestJSON-734361258-project] 10.222.0.15 "GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f" status: 404 len: 111 microversion: 2.20 time: 0.030643 Jun 27 18:52:16.532112 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 417/815] 10.222.0.15 () {60 vars in 1276 bytes} [Mon Jun 27 18:52:16 2022] GET /compute/v2.1/servers/91366512-6fa4-4a20-a867-94852749b02f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 18:52:16.925200 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-11943273-c949-4b2d-b0b9-8db40700b6da tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:16.927340 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-11943273-c949-4b2d-b0b9-8db40700b6da tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:16.932334 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-11943273-c949-4b2d-b0b9-8db40700b6da tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:16.932777 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-11943273-c949-4b2d-b0b9-8db40700b6da tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:16.933577 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-11943273-c949-4b2d-b0b9-8db40700b6da tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:16.934010 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-11943273-c949-4b2d-b0b9-8db40700b6da tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:17.208308 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-11943273-c949-4b2d-b0b9-8db40700b6da tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:17.216056 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-11943273-c949-4b2d-b0b9-8db40700b6da tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1576 microversion: 2.1 time: 0.294618 Jun 27 18:52:17.217200 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 399/816] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:16 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1576 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:18.233823 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-673fefd5-8f89-42d2-a6b2-f289348d94a0 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:18.234518 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-673fefd5-8f89-42d2-a6b2-f289348d94a0 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:18.242719 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-673fefd5-8f89-42d2-a6b2-f289348d94a0 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:18.243824 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-673fefd5-8f89-42d2-a6b2-f289348d94a0 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:18.244627 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-673fefd5-8f89-42d2-a6b2-f289348d94a0 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:18.245831 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-673fefd5-8f89-42d2-a6b2-f289348d94a0 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:18.724690 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-673fefd5-8f89-42d2-a6b2-f289348d94a0 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:18.733739 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-673fefd5-8f89-42d2-a6b2-f289348d94a0 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1576 microversion: 2.1 time: 0.503973 Jun 27 18:52:18.734421 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 418/817] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:18 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1576 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:19.092702 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-56dcbed0-3e70-4b6c-b146-08e867e24c84 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-204081283", "imageRef": "c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3", "flavorRef": "452"}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:52:19.148254 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.network.neutron [None req-56dcbed0-3e70-4b6c-b146-08e867e24c84 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] validate_networks() for None {{(pid=124717) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 18:52:19.629162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-56dcbed0-3e70-4b6c-b146-08e867e24c84 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Flavor limits 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 18:52:19.629584 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-56dcbed0-3e70-4b6c-b146-08e867e24c84 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Image limits 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 18:52:19.630070 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-56dcbed0-3e70-4b6c-b146-08e867e24c84 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Flavor pref 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 18:52:19.630501 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-56dcbed0-3e70-4b6c-b146-08e867e24c84 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Image pref 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 18:52:19.630909 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-56dcbed0-3e70-4b6c-b146-08e867e24c84 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 18:52:19.641462 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-56dcbed0-3e70-4b6c-b146-08e867e24c84 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:19.641911 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-56dcbed0-3e70-4b6c-b146-08e867e24c84 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:19.642818 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-56dcbed0-3e70-4b6c-b146-08e867e24c84 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:19.643256 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-56dcbed0-3e70-4b6c-b146-08e867e24c84 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:19.659988 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-56dcbed0-3e70-4b6c-b146-08e867e24c84 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Getting quotas for project ac1847cdd8cc43d9b34490bd5e871e2b. Resources: {'ram', 'cores', 'instances'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:52:19.665795 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-56dcbed0-3e70-4b6c-b146-08e867e24c84 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Getting quotas for user aa14260afbce48ffbb851ff7065aea64 and project ac1847cdd8cc43d9b34490bd5e871e2b. Resources: {'ram', 'cores', 'instances'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:52:19.676797 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-56dcbed0-3e70-4b6c-b146-08e867e24c84 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Going to run 1 instances... {{(pid=124717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 18:52:19.679248 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-56dcbed0-3e70-4b6c-b146-08e867e24c84 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] [instance: 205d0485-cd73-4ab6-b52f-cc6e90382a0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 18:52:19.759080 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-526b9395-db53-47c3-b690-1908e5ba94f7 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:19.760805 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-526b9395-db53-47c3-b690-1908e5ba94f7 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:19.776408 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-526b9395-db53-47c3-b690-1908e5ba94f7 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:19.777168 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-526b9395-db53-47c3-b690-1908e5ba94f7 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:19.779107 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-526b9395-db53-47c3-b690-1908e5ba94f7 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:19.779762 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-526b9395-db53-47c3-b690-1908e5ba94f7 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:19.800954 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-56dcbed0-3e70-4b6c-b146-08e867e24c84 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711708 Jun 27 18:52:19.801851 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 400/818] 10.222.0.15 () {60 vars in 1146 bytes} [Mon Jun 27 18:52:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 18:52:19.814842 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-424c8f2d-43cc-45a9-94d0-4e6cd4576e9c tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:19.815833 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-424c8f2d-43cc-45a9-94d0-4e6cd4576e9c tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] [instance: 205d0485-cd73-4ab6-b52f-cc6e90382a0f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:19.936534 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-424c8f2d-43cc-45a9-94d0-4e6cd4576e9c tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa14260afbce48ffbb851ff7065aea64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1847cdd8cc43d9b34490bd5e871e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:19.946882 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-424c8f2d-43cc-45a9-94d0-4e6cd4576e9c tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] 10.222.0.15 "GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f" status: 200 len: 1214 microversion: 2.1 time: 0.136018 Jun 27 18:52:19.949120 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 401/819] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:19 2022] GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:20.037944 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-526b9395-db53-47c3-b690-1908e5ba94f7 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:20.046155 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-526b9395-db53-47c3-b690-1908e5ba94f7 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1576 microversion: 2.1 time: 0.297956 Jun 27 18:52:20.046760 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 419/820] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:19 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1576 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:52:20.965009 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-73e85658-3e80-4f8c-993c-cda6f391212b tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:20.965617 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-73e85658-3e80-4f8c-993c-cda6f391212b tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] [instance: 205d0485-cd73-4ab6-b52f-cc6e90382a0f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:20.976598 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-73e85658-3e80-4f8c-993c-cda6f391212b tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:20.976598 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-73e85658-3e80-4f8c-993c-cda6f391212b tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:20.976598 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-73e85658-3e80-4f8c-993c-cda6f391212b tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:20.976598 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-73e85658-3e80-4f8c-993c-cda6f391212b tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:21.035784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-73e85658-3e80-4f8c-993c-cda6f391212b tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa14260afbce48ffbb851ff7065aea64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1847cdd8cc43d9b34490bd5e871e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:21.043767 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-73e85658-3e80-4f8c-993c-cda6f391212b tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] 10.222.0.15 "GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f" status: 200 len: 1218 microversion: 2.1 time: 0.083324 Jun 27 18:52:21.044337 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 402/821] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:20 2022] GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:21.063272 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-266f2a55-93a7-47e0-aebb-153c17711903 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:21.063910 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-266f2a55-93a7-47e0-aebb-153c17711903 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:21.070295 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-266f2a55-93a7-47e0-aebb-153c17711903 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:21.070776 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-266f2a55-93a7-47e0-aebb-153c17711903 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:21.071780 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-266f2a55-93a7-47e0-aebb-153c17711903 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:21.072215 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-266f2a55-93a7-47e0-aebb-153c17711903 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:21.204475 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-266f2a55-93a7-47e0-aebb-153c17711903 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:21.213931 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-266f2a55-93a7-47e0-aebb-153c17711903 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1576 microversion: 2.1 time: 0.153714 Jun 27 18:52:21.214581 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 420/822] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:21 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:22.061961 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-271d3be9-b8c5-4c9d-90f3-a596fd0b62bb tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:22.062636 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-271d3be9-b8c5-4c9d-90f3-a596fd0b62bb tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] [instance: 205d0485-cd73-4ab6-b52f-cc6e90382a0f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:22.069087 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-271d3be9-b8c5-4c9d-90f3-a596fd0b62bb tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:22.069533 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-271d3be9-b8c5-4c9d-90f3-a596fd0b62bb tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:22.070305 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-271d3be9-b8c5-4c9d-90f3-a596fd0b62bb tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:22.070780 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-271d3be9-b8c5-4c9d-90f3-a596fd0b62bb tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:22.134423 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-271d3be9-b8c5-4c9d-90f3-a596fd0b62bb tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa14260afbce48ffbb851ff7065aea64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1847cdd8cc43d9b34490bd5e871e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:22.141866 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-271d3be9-b8c5-4c9d-90f3-a596fd0b62bb tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] 10.222.0.15 "GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f" status: 200 len: 1218 microversion: 2.1 time: 0.084602 Jun 27 18:52:22.142447 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 403/823] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:22 2022] GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:22.231682 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-2346cb59-ccc6-42f2-9d4e-7539b8267703 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:22.232306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-2346cb59-ccc6-42f2-9d4e-7539b8267703 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:22.239511 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2346cb59-ccc6-42f2-9d4e-7539b8267703 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:22.239971 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2346cb59-ccc6-42f2-9d4e-7539b8267703 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:22.240752 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2346cb59-ccc6-42f2-9d4e-7539b8267703 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:22.241194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2346cb59-ccc6-42f2-9d4e-7539b8267703 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:22.380365 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-2346cb59-ccc6-42f2-9d4e-7539b8267703 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:22.388232 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-2346cb59-ccc6-42f2-9d4e-7539b8267703 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1576 microversion: 2.1 time: 0.161236 Jun 27 18:52:22.388798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 421/824] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:22 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:23.158873 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-971a413a-6106-4cc4-8b99-04caf97b8572 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:23.159481 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-971a413a-6106-4cc4-8b99-04caf97b8572 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] [instance: 205d0485-cd73-4ab6-b52f-cc6e90382a0f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:23.166156 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-971a413a-6106-4cc4-8b99-04caf97b8572 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:23.166673 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-971a413a-6106-4cc4-8b99-04caf97b8572 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:23.167432 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-971a413a-6106-4cc4-8b99-04caf97b8572 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:23.167873 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-971a413a-6106-4cc4-8b99-04caf97b8572 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:23.229584 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-971a413a-6106-4cc4-8b99-04caf97b8572 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa14260afbce48ffbb851ff7065aea64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1847cdd8cc43d9b34490bd5e871e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:23.237033 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-971a413a-6106-4cc4-8b99-04caf97b8572 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] 10.222.0.15 "GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f" status: 200 len: 1218 microversion: 2.1 time: 0.082306 Jun 27 18:52:23.237585 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 404/825] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:23 2022] GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:23.405762 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-dbd9f297-9cb1-40de-a781-4531b3f9aeca tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:23.407130 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-dbd9f297-9cb1-40de-a781-4531b3f9aeca tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:23.420183 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-dbd9f297-9cb1-40de-a781-4531b3f9aeca tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:23.420183 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-dbd9f297-9cb1-40de-a781-4531b3f9aeca tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:23.420183 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-dbd9f297-9cb1-40de-a781-4531b3f9aeca tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:23.420183 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-dbd9f297-9cb1-40de-a781-4531b3f9aeca tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:23.564224 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-dbd9f297-9cb1-40de-a781-4531b3f9aeca tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:23.585398 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-dbd9f297-9cb1-40de-a781-4531b3f9aeca tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1576 microversion: 2.1 time: 0.175346 Jun 27 18:52:23.585398 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 422/826] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:23 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:24.255150 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-760f361b-3b90-4b55-b32b-0ba0e71ec4a4 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:24.255825 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-760f361b-3b90-4b55-b32b-0ba0e71ec4a4 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] [instance: 205d0485-cd73-4ab6-b52f-cc6e90382a0f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:24.268368 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-760f361b-3b90-4b55-b32b-0ba0e71ec4a4 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:24.268825 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-760f361b-3b90-4b55-b32b-0ba0e71ec4a4 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:24.269610 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-760f361b-3b90-4b55-b32b-0ba0e71ec4a4 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:24.282696 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-760f361b-3b90-4b55-b32b-0ba0e71ec4a4 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:24.382033 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-760f361b-3b90-4b55-b32b-0ba0e71ec4a4 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa14260afbce48ffbb851ff7065aea64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1847cdd8cc43d9b34490bd5e871e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:24.390522 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-760f361b-3b90-4b55-b32b-0ba0e71ec4a4 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] 10.222.0.15 "GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f" status: 200 len: 1274 microversion: 2.1 time: 0.139460 Jun 27 18:52:24.391219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 405/827] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:24 2022] GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f => generated 1274 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:24.595532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-4de3c6d5-8caa-4646-82e6-23c4fec0610c tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:24.596149 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-4de3c6d5-8caa-4646-82e6-23c4fec0610c tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:24.605165 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4de3c6d5-8caa-4646-82e6-23c4fec0610c tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:24.606949 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4de3c6d5-8caa-4646-82e6-23c4fec0610c tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:24.606949 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4de3c6d5-8caa-4646-82e6-23c4fec0610c tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:24.607530 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4de3c6d5-8caa-4646-82e6-23c4fec0610c tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:24.764699 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-4de3c6d5-8caa-4646-82e6-23c4fec0610c tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:24.774710 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-4de3c6d5-8caa-4646-82e6-23c4fec0610c tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1576 microversion: 2.1 time: 0.182068 Jun 27 18:52:24.775694 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 423/828] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:24 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:25.407830 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-50751fc5-4274-47c6-96cb-db5477946d37 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:25.408450 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-50751fc5-4274-47c6-96cb-db5477946d37 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] [instance: 205d0485-cd73-4ab6-b52f-cc6e90382a0f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:25.415138 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-50751fc5-4274-47c6-96cb-db5477946d37 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:25.416371 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-50751fc5-4274-47c6-96cb-db5477946d37 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:25.417445 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-50751fc5-4274-47c6-96cb-db5477946d37 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:25.417911 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-50751fc5-4274-47c6-96cb-db5477946d37 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:25.487634 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-50751fc5-4274-47c6-96cb-db5477946d37 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa14260afbce48ffbb851ff7065aea64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1847cdd8cc43d9b34490bd5e871e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:25.495965 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-50751fc5-4274-47c6-96cb-db5477946d37 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] 10.222.0.15 "GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f" status: 200 len: 1272 microversion: 2.1 time: 0.091956 Jun 27 18:52:25.497862 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 406/829] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:25 2022] GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f => generated 1272 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:25.792289 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-fd0211f1-5ec1-4aef-af31-24ddeb81d49b tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:25.792913 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-fd0211f1-5ec1-4aef-af31-24ddeb81d49b tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:25.805656 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd0211f1-5ec1-4aef-af31-24ddeb81d49b tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:25.806782 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd0211f1-5ec1-4aef-af31-24ddeb81d49b tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:25.807625 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd0211f1-5ec1-4aef-af31-24ddeb81d49b tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:25.808070 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd0211f1-5ec1-4aef-af31-24ddeb81d49b tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:25.976842 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-fd0211f1-5ec1-4aef-af31-24ddeb81d49b tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:25.996979 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-fd0211f1-5ec1-4aef-af31-24ddeb81d49b tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1576 microversion: 2.1 time: 0.206582 Jun 27 18:52:25.997626 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 424/830] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:25 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:26.514190 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e32601c8-d868-4609-b8c7-7fb05345f1aa tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:26.514880 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e32601c8-d868-4609-b8c7-7fb05345f1aa tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] [instance: 205d0485-cd73-4ab6-b52f-cc6e90382a0f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:26.521927 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e32601c8-d868-4609-b8c7-7fb05345f1aa tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:26.522605 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e32601c8-d868-4609-b8c7-7fb05345f1aa tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:26.523642 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e32601c8-d868-4609-b8c7-7fb05345f1aa tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:26.524087 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e32601c8-d868-4609-b8c7-7fb05345f1aa tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:26.686185 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-e32601c8-d868-4609-b8c7-7fb05345f1aa tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa14260afbce48ffbb851ff7065aea64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1847cdd8cc43d9b34490bd5e871e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:26.694586 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e32601c8-d868-4609-b8c7-7fb05345f1aa tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] 10.222.0.15 "GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f" status: 200 len: 1314 microversion: 2.1 time: 0.185246 Jun 27 18:52:26.695171 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 407/831] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:26 2022] GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:27.015064 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-d75b1124-c265-46a6-aade-f66d494c053e tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:27.017013 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-d75b1124-c265-46a6-aade-f66d494c053e tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:27.024154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d75b1124-c265-46a6-aade-f66d494c053e tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:27.026766 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d75b1124-c265-46a6-aade-f66d494c053e tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:27.026766 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d75b1124-c265-46a6-aade-f66d494c053e tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:27.026766 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d75b1124-c265-46a6-aade-f66d494c053e tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:27.041405 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=100 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:27.189892 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-d75b1124-c265-46a6-aade-f66d494c053e tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:27.199692 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-d75b1124-c265-46a6-aade-f66d494c053e tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1576 microversion: 2.1 time: 0.188490 Jun 27 18:52:27.210062 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 425/832] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:27 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1576 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:52:27.713799 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0ce4e1e5-20f7-40e5-9d24-88405d371034 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:27.715292 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-0ce4e1e5-20f7-40e5-9d24-88405d371034 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] [instance: 205d0485-cd73-4ab6-b52f-cc6e90382a0f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:27.721922 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0ce4e1e5-20f7-40e5-9d24-88405d371034 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:27.722579 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0ce4e1e5-20f7-40e5-9d24-88405d371034 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:27.723346 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0ce4e1e5-20f7-40e5-9d24-88405d371034 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:27.723963 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0ce4e1e5-20f7-40e5-9d24-88405d371034 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:27.908226 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-81b00bc1-c262-452f-9eb2-f6ec165ee7be req-623d07f0-b216-45d7-8c6b-7739caa2ed56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "205d0485-cd73-4ab6-b52f-cc6e90382a0f", "tag": "37c6eeac-405c-4f2f-aa85-7697256e0a6a"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:52:27.925107 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-81b00bc1-c262-452f-9eb2-f6ec165ee7be req-623d07f0-b216-45d7-8c6b-7739caa2ed56 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:27.925633 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-81b00bc1-c262-452f-9eb2-f6ec165ee7be req-623d07f0-b216-45d7-8c6b-7739caa2ed56 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:27.959196 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-81b00bc1-c262-452f-9eb2-f6ec165ee7be req-623d07f0-b216-45d7-8c6b-7739caa2ed56 service nova] Creating event network-changed:37c6eeac-405c-4f2f-aa85-7697256e0a6a for instance 205d0485-cd73-4ab6-b52f-cc6e90382a0f on hv-cinder-84460 Jun 27 18:52:27.965501 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-81b00bc1-c262-452f-9eb2-f6ec165ee7be req-623d07f0-b216-45d7-8c6b-7739caa2ed56 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070990 Jun 27 18:52:27.966645 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 426/833] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:52:28.099854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-0ce4e1e5-20f7-40e5-9d24-88405d371034 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa14260afbce48ffbb851ff7065aea64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1847cdd8cc43d9b34490bd5e871e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:28.110858 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-0ce4e1e5-20f7-40e5-9d24-88405d371034 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] 10.222.0.15 "GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f" status: 200 len: 1314 microversion: 2.1 time: 0.401460 Jun 27 18:52:28.112702 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 408/834] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:27 2022] GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:28.218194 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-73738a2f-3c6b-46e0-a3e9-246f4e991a69 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:28.220373 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-73738a2f-3c6b-46e0-a3e9-246f4e991a69 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:28.226210 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-73738a2f-3c6b-46e0-a3e9-246f4e991a69 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:28.227091 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-73738a2f-3c6b-46e0-a3e9-246f4e991a69 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:28.228758 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-73738a2f-3c6b-46e0-a3e9-246f4e991a69 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:28.229568 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-73738a2f-3c6b-46e0-a3e9-246f4e991a69 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:28.412868 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-73738a2f-3c6b-46e0-a3e9-246f4e991a69 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:28.422429 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-73738a2f-3c6b-46e0-a3e9-246f4e991a69 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1576 microversion: 2.1 time: 0.208910 Jun 27 18:52:28.423108 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 427/835] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:28 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:28.893240 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-4bdf6682-9fc4-4ad3-9d50-d0fc6577e28e req-a59cea9d-2442-4b40-99fe-48d4eac536f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a731689-b26b-4f41-a3d3-4d1a2ebff239", "name": "network-vif-plugged", "status": "completed", "tag": "d446f8e5-97d8-434f-9b91-31d20061c950"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:52:28.902852 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:28.905632 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-4bdf6682-9fc4-4ad3-9d50-d0fc6577e28e req-a59cea9d-2442-4b40-99fe-48d4eac536f0 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:28.909208 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-4bdf6682-9fc4-4ad3-9d50-d0fc6577e28e req-a59cea9d-2442-4b40-99fe-48d4eac536f0 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:28.922844 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-4bdf6682-9fc4-4ad3-9d50-d0fc6577e28e req-a59cea9d-2442-4b40-99fe-48d4eac536f0 service nova] Creating event network-vif-plugged:d446f8e5-97d8-434f-9b91-31d20061c950 for instance 2a731689-b26b-4f41-a3d3-4d1a2ebff239 on hv-cinder-84460 Jun 27 18:52:28.928656 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-4bdf6682-9fc4-4ad3-9d50-d0fc6577e28e req-a59cea9d-2442-4b40-99fe-48d4eac536f0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040476 Jun 27 18:52:28.930005 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 409/836] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:52:29.131065 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-8679883c-e4c0-442e-bd93-67e847d5e0cd tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:29.133571 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-8679883c-e4c0-442e-bd93-67e847d5e0cd tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] [instance: 205d0485-cd73-4ab6-b52f-cc6e90382a0f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:29.142330 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8679883c-e4c0-442e-bd93-67e847d5e0cd tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:29.143073 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8679883c-e4c0-442e-bd93-67e847d5e0cd tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:29.144413 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8679883c-e4c0-442e-bd93-67e847d5e0cd tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:29.145030 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8679883c-e4c0-442e-bd93-67e847d5e0cd tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:29.342370 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-8679883c-e4c0-442e-bd93-67e847d5e0cd tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa14260afbce48ffbb851ff7065aea64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1847cdd8cc43d9b34490bd5e871e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:29.351743 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-8679883c-e4c0-442e-bd93-67e847d5e0cd tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] 10.222.0.15 "GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f" status: 200 len: 1314 microversion: 2.1 time: 0.225497 Jun 27 18:52:29.352791 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 428/837] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:29 2022] GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:29.441851 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-b2c79d40-87cb-4151-8e48-39f3b5e2f117 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:29.443962 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-b2c79d40-87cb-4151-8e48-39f3b5e2f117 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:29.453344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b2c79d40-87cb-4151-8e48-39f3b5e2f117 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:29.456822 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b2c79d40-87cb-4151-8e48-39f3b5e2f117 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:29.458090 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b2c79d40-87cb-4151-8e48-39f3b5e2f117 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:29.458608 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b2c79d40-87cb-4151-8e48-39f3b5e2f117 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:29.656924 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell0:SELECT=2 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:29.694424 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-b2c79d40-87cb-4151-8e48-39f3b5e2f117 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:29.708914 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-b2c79d40-87cb-4151-8e48-39f3b5e2f117 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1576 microversion: 2.1 time: 0.271209 Jun 27 18:52:29.710417 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 410/838] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:29 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1576 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:30.370720 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-93b49d9e-d9a4-4504-93e6-14f5bdbdafb4 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:30.372946 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-93b49d9e-d9a4-4504-93e6-14f5bdbdafb4 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] [instance: 205d0485-cd73-4ab6-b52f-cc6e90382a0f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:30.381290 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-93b49d9e-d9a4-4504-93e6-14f5bdbdafb4 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:30.381290 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-93b49d9e-d9a4-4504-93e6-14f5bdbdafb4 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:30.381870 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-93b49d9e-d9a4-4504-93e6-14f5bdbdafb4 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:30.382472 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-93b49d9e-d9a4-4504-93e6-14f5bdbdafb4 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:30.568525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-93b49d9e-d9a4-4504-93e6-14f5bdbdafb4 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa14260afbce48ffbb851ff7065aea64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1847cdd8cc43d9b34490bd5e871e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:30.576651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-93b49d9e-d9a4-4504-93e6-14f5bdbdafb4 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] 10.222.0.15 "GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f" status: 200 len: 1314 microversion: 2.1 time: 0.211518 Jun 27 18:52:30.577552 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 429/839] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:30 2022] GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:30.728685 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-07bfa3ab-76ae-43c6-8098-e393ccfbd4d8 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:30.729397 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-07bfa3ab-76ae-43c6-8098-e393ccfbd4d8 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:30.732478 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell0:SELECT=8 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:30.741235 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-07bfa3ab-76ae-43c6-8098-e393ccfbd4d8 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:30.743000 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-07bfa3ab-76ae-43c6-8098-e393ccfbd4d8 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:30.744350 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-07bfa3ab-76ae-43c6-8098-e393ccfbd4d8 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:30.744800 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-07bfa3ab-76ae-43c6-8098-e393ccfbd4d8 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:30.979069 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-07bfa3ab-76ae-43c6-8098-e393ccfbd4d8 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:30.979069 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-07bfa3ab-76ae-43c6-8098-e393ccfbd4d8 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1576 microversion: 2.1 time: 0.238784 Jun 27 18:52:30.979069 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 411/840] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:30 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1576 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:31.198511 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-587d8017-d0a0-4a6a-ba0d-38366fe19ff3 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Action: 'create', calling method: .version_select at 0x7f700f5ff940>, body: {"keypair": {"name": "tempest-keypair-423695440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxcpU9BK5Jw5KkgUFJUK6jsGiUjrulqyQAZz3C55tkQAv6iVtcwOcUbNISwJG4SnxKGCwNpeO4SOp3cqknDC78clN/+deKwOK+Y8qdlrhMZNQZ7zeGAIqzwjsSWt0oWKA=="}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:52:31.212936 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-587d8017-d0a0-4a6a-ba0d-38366fe19ff3 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Getting quotas for project a981ae734b1e4993bb440918b1a74fe7. Resources: {'key_pairs'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:52:31.217045 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-587d8017-d0a0-4a6a-ba0d-38366fe19ff3 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Getting quotas for user 48ac761d30de4fb49478a78ccf23ab92 and project a981ae734b1e4993bb440918b1a74fe7. Resources: {'key_pairs'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:52:31.330125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-587d8017-d0a0-4a6a-ba0d-38366fe19ff3 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.369249 Jun 27 18:52:31.333925 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 430/841] 10.222.0.15 () {60 vars in 1158 bytes} [Mon Jun 27 18:52:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:52:31.593618 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a2635e77-c643-41ad-8b8f-9f0841e0108e tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:31.594251 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-a2635e77-c643-41ad-8b8f-9f0841e0108e tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] [instance: 205d0485-cd73-4ab6-b52f-cc6e90382a0f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:31.602492 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a2635e77-c643-41ad-8b8f-9f0841e0108e tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:31.603297 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a2635e77-c643-41ad-8b8f-9f0841e0108e tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:31.604279 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a2635e77-c643-41ad-8b8f-9f0841e0108e tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:31.604881 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a2635e77-c643-41ad-8b8f-9f0841e0108e tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:31.787083 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a2635e77-c643-41ad-8b8f-9f0841e0108e tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa14260afbce48ffbb851ff7065aea64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1847cdd8cc43d9b34490bd5e871e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:31.800683 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-a2635e77-c643-41ad-8b8f-9f0841e0108e tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] 10.222.0.15 "GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f" status: 200 len: 1314 microversion: 2.1 time: 0.208218 Jun 27 18:52:31.810682 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 412/842] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:31 2022] GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:31.998153 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-71eacc96-12a6-4be3-b7bc-594d23bb9831 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:31.999390 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-71eacc96-12a6-4be3-b7bc-594d23bb9831 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:32.004386 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:32.008462 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-71eacc96-12a6-4be3-b7bc-594d23bb9831 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:32.008909 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-71eacc96-12a6-4be3-b7bc-594d23bb9831 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:32.010595 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-71eacc96-12a6-4be3-b7bc-594d23bb9831 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:32.011106 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-71eacc96-12a6-4be3-b7bc-594d23bb9831 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:32.179028 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-71eacc96-12a6-4be3-b7bc-594d23bb9831 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:32.193336 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-71eacc96-12a6-4be3-b7bc-594d23bb9831 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1563 microversion: 2.1 time: 0.202827 Jun 27 18:52:32.194678 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 431/843] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:31 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1563 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:32.817141 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-824d2c44-dcc6-4854-8d16-06a423af19f5 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:32.818329 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-824d2c44-dcc6-4854-8d16-06a423af19f5 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] [instance: 205d0485-cd73-4ab6-b52f-cc6e90382a0f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:32.826099 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-824d2c44-dcc6-4854-8d16-06a423af19f5 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:32.827041 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-824d2c44-dcc6-4854-8d16-06a423af19f5 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:32.828377 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-824d2c44-dcc6-4854-8d16-06a423af19f5 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:32.828974 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-824d2c44-dcc6-4854-8d16-06a423af19f5 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:33.119750 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-824d2c44-dcc6-4854-8d16-06a423af19f5 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa14260afbce48ffbb851ff7065aea64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1847cdd8cc43d9b34490bd5e871e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:33.128127 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-824d2c44-dcc6-4854-8d16-06a423af19f5 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] 10.222.0.15 "GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f" status: 200 len: 1314 microversion: 2.1 time: 0.314826 Jun 27 18:52:33.128818 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 413/844] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:32 2022] GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:34.145832 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7f990fbf-d565-4c01-b086-e4ec3c4e39b8 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:34.146597 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-7f990fbf-d565-4c01-b086-e4ec3c4e39b8 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] [instance: 205d0485-cd73-4ab6-b52f-cc6e90382a0f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:34.153992 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7f990fbf-d565-4c01-b086-e4ec3c4e39b8 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:34.154472 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7f990fbf-d565-4c01-b086-e4ec3c4e39b8 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:34.155288 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7f990fbf-d565-4c01-b086-e4ec3c4e39b8 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:34.155732 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7f990fbf-d565-4c01-b086-e4ec3c4e39b8 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:34.174678 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0f7874f9-6c1b-43a3-a280-adc6b461cca7 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1322945740", "imageRef": "c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "580ec2de-be59-4921-adbe-91c7f9d3a376"}], "security_groups": [{"name": "tempest-securitygroup--1980613312"}], "key_name": "tempest-keypair-423695440", "user_data": "}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:52:34.319349 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.network.neutron [None req-0f7874f9-6c1b-43a3-a280-adc6b461cca7 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] validate_networks() for [('580ec2de-be59-4921-adbe-91c7f9d3a376', None, None, None, None, None)] {{(pid=124717) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 18:52:34.323677 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-7f990fbf-d565-4c01-b086-e4ec3c4e39b8 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa14260afbce48ffbb851ff7065aea64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1847cdd8cc43d9b34490bd5e871e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:34.331215 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-7f990fbf-d565-4c01-b086-e4ec3c4e39b8 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] 10.222.0.15 "GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f" status: 200 len: 1314 microversion: 2.1 time: 0.190007 Jun 27 18:52:34.331793 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 432/845] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:34 2022] GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:34.718957 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-0f7874f9-6c1b-43a3-a280-adc6b461cca7 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Flavor limits 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 18:52:34.719399 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-0f7874f9-6c1b-43a3-a280-adc6b461cca7 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Image limits 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 18:52:34.719872 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-0f7874f9-6c1b-43a3-a280-adc6b461cca7 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Flavor pref 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 18:52:34.720315 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-0f7874f9-6c1b-43a3-a280-adc6b461cca7 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Image pref 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 18:52:34.720723 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-0f7874f9-6c1b-43a3-a280-adc6b461cca7 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 18:52:34.730518 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0f7874f9-6c1b-43a3-a280-adc6b461cca7 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:34.730962 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0f7874f9-6c1b-43a3-a280-adc6b461cca7 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:34.731750 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0f7874f9-6c1b-43a3-a280-adc6b461cca7 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:34.732181 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0f7874f9-6c1b-43a3-a280-adc6b461cca7 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:34.751503 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-0f7874f9-6c1b-43a3-a280-adc6b461cca7 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Getting quotas for project a981ae734b1e4993bb440918b1a74fe7. Resources: {'ram', 'cores', 'instances'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:52:34.755487 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-0f7874f9-6c1b-43a3-a280-adc6b461cca7 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Getting quotas for user 48ac761d30de4fb49478a78ccf23ab92 and project a981ae734b1e4993bb440918b1a74fe7. Resources: {'ram', 'cores', 'instances'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:52:34.767514 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-0f7874f9-6c1b-43a3-a280-adc6b461cca7 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Going to run 1 instances... {{(pid=124717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 18:52:34.769769 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-0f7874f9-6c1b-43a3-a280-adc6b461cca7 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 18:52:34.855706 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-241bf709-52ab-4bc9-b9eb-76593a91eba8 req-3760de2e-6e53-4dfb-ad0e-abe20118c786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "205d0485-cd73-4ab6-b52f-cc6e90382a0f", "name": "network-vif-plugged", "status": "completed", "tag": "37c6eeac-405c-4f2f-aa85-7697256e0a6a"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:52:34.864000 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-241bf709-52ab-4bc9-b9eb-76593a91eba8 req-3760de2e-6e53-4dfb-ad0e-abe20118c786 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:34.864444 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-241bf709-52ab-4bc9-b9eb-76593a91eba8 req-3760de2e-6e53-4dfb-ad0e-abe20118c786 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:34.876959 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-241bf709-52ab-4bc9-b9eb-76593a91eba8 req-3760de2e-6e53-4dfb-ad0e-abe20118c786 service nova] Creating event network-vif-plugged:37c6eeac-405c-4f2f-aa85-7697256e0a6a for instance 205d0485-cd73-4ab6-b52f-cc6e90382a0f on hv-cinder-84460 Jun 27 18:52:34.882833 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-0f7874f9-6c1b-43a3-a280-adc6b461cca7 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.712532 Jun 27 18:52:34.883241 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-241bf709-52ab-4bc9-b9eb-76593a91eba8 req-3760de2e-6e53-4dfb-ad0e-abe20118c786 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031461 Jun 27 18:52:34.886406 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 414/846] 10.222.0.15 () {60 vars in 1146 bytes} [Mon Jun 27 18:52:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 18:52:34.886571 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 433/847] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:52:34.894657 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-5169eaa7-1e70-4f8c-bde8-1043136f9f3c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:34.895288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-5169eaa7-1e70-4f8c-bde8-1043136f9f3c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:34.963292 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-5169eaa7-1e70-4f8c-bde8-1043136f9f3c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:34.970410 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-5169eaa7-1e70-4f8c-bde8-1043136f9f3c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22" status: 200 len: 1241 microversion: 2.1 time: 0.080542 Jun 27 18:52:34.980224 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 415/848] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:34 2022] GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:35.348981 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-51d917c5-7e93-40ac-8662-3737ae25d14e tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:35.349681 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-51d917c5-7e93-40ac-8662-3737ae25d14e tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] [instance: 205d0485-cd73-4ab6-b52f-cc6e90382a0f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:35.356920 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-51d917c5-7e93-40ac-8662-3737ae25d14e tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:35.357363 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-51d917c5-7e93-40ac-8662-3737ae25d14e tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:35.358114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-51d917c5-7e93-40ac-8662-3737ae25d14e tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:35.358591 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-51d917c5-7e93-40ac-8662-3737ae25d14e tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:35.501384 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-51d917c5-7e93-40ac-8662-3737ae25d14e tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa14260afbce48ffbb851ff7065aea64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1847cdd8cc43d9b34490bd5e871e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:35.509291 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-51d917c5-7e93-40ac-8662-3737ae25d14e tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] 10.222.0.15 "GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f" status: 200 len: 1314 microversion: 2.1 time: 0.164529 Jun 27 18:52:35.509961 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 434/849] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:35 2022] GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:35.988074 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e790b203-b0b6-41fd-bdcf-09036113f618 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:35.988699 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e790b203-b0b6-41fd-bdcf-09036113f618 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:35.996886 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e790b203-b0b6-41fd-bdcf-09036113f618 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:35.997343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e790b203-b0b6-41fd-bdcf-09036113f618 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:35.998125 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e790b203-b0b6-41fd-bdcf-09036113f618 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:35.998600 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e790b203-b0b6-41fd-bdcf-09036113f618 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:36.062842 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-e790b203-b0b6-41fd-bdcf-09036113f618 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:36.066202 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:36.070445 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e790b203-b0b6-41fd-bdcf-09036113f618 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22" status: 200 len: 1245 microversion: 2.1 time: 0.086338 Jun 27 18:52:36.071017 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 416/850] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:35 2022] GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:36.526980 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a78fda58-0452-4831-8132-7a6186bf37a6 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:36.527605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a78fda58-0452-4831-8132-7a6186bf37a6 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] [instance: 205d0485-cd73-4ab6-b52f-cc6e90382a0f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:36.534097 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a78fda58-0452-4831-8132-7a6186bf37a6 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:36.534575 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a78fda58-0452-4831-8132-7a6186bf37a6 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:36.535344 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a78fda58-0452-4831-8132-7a6186bf37a6 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:36.535779 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a78fda58-0452-4831-8132-7a6186bf37a6 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:36.666218 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a78fda58-0452-4831-8132-7a6186bf37a6 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa14260afbce48ffbb851ff7065aea64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1847cdd8cc43d9b34490bd5e871e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:36.673782 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a78fda58-0452-4831-8132-7a6186bf37a6 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] 10.222.0.15 "GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f" status: 200 len: 1314 microversion: 2.1 time: 0.151303 Jun 27 18:52:36.674360 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 435/851] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:36 2022] GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:37.088170 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-6ee60618-e6b6-4a83-9a1f-eb250f9aaa8a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:37.088784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-6ee60618-e6b6-4a83-9a1f-eb250f9aaa8a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:37.095634 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6ee60618-e6b6-4a83-9a1f-eb250f9aaa8a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:37.096083 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6ee60618-e6b6-4a83-9a1f-eb250f9aaa8a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:37.096874 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6ee60618-e6b6-4a83-9a1f-eb250f9aaa8a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:37.097306 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-6ee60618-e6b6-4a83-9a1f-eb250f9aaa8a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:37.159110 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-6ee60618-e6b6-4a83-9a1f-eb250f9aaa8a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:37.167444 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-6ee60618-e6b6-4a83-9a1f-eb250f9aaa8a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22" status: 200 len: 1293 microversion: 2.1 time: 0.083536 Jun 27 18:52:37.168076 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 417/852] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:37 2022] GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:37.690799 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-145c976a-d4cd-43ad-8ba9-81fe3772bf12 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:37.692067 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-145c976a-d4cd-43ad-8ba9-81fe3772bf12 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] [instance: 205d0485-cd73-4ab6-b52f-cc6e90382a0f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:37.699032 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-145c976a-d4cd-43ad-8ba9-81fe3772bf12 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:37.699719 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-145c976a-d4cd-43ad-8ba9-81fe3772bf12 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:37.700684 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-145c976a-d4cd-43ad-8ba9-81fe3772bf12 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:37.701302 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-145c976a-d4cd-43ad-8ba9-81fe3772bf12 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:38.124235 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-145c976a-d4cd-43ad-8ba9-81fe3772bf12 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa14260afbce48ffbb851ff7065aea64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1847cdd8cc43d9b34490bd5e871e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:38.133536 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-145c976a-d4cd-43ad-8ba9-81fe3772bf12 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] 10.222.0.15 "GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f" status: 200 len: 1463 microversion: 2.1 time: 0.446548 Jun 27 18:52:38.134118 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 436/853] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:37 2022] GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f => generated 1463 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:38.175679 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0997f61e-c7c2-438f-924b-2ab4ea352ef5 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:38.176208 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-0997f61e-c7c2-438f-924b-2ab4ea352ef5 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] [instance: 205d0485-cd73-4ab6-b52f-cc6e90382a0f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:38.183906 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0997f61e-c7c2-438f-924b-2ab4ea352ef5 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:38.184362 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0997f61e-c7c2-438f-924b-2ab4ea352ef5 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:38.185135 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0997f61e-c7c2-438f-924b-2ab4ea352ef5 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:38.185575 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0997f61e-c7c2-438f-924b-2ab4ea352ef5 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:38.188245 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-6877b585-7a13-4afa-98ff-6ea676fc4396 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:38.189017 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-6877b585-7a13-4afa-98ff-6ea676fc4396 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:38.194772 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6877b585-7a13-4afa-98ff-6ea676fc4396 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:38.195225 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6877b585-7a13-4afa-98ff-6ea676fc4396 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:38.195997 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6877b585-7a13-4afa-98ff-6ea676fc4396 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:38.196440 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6877b585-7a13-4afa-98ff-6ea676fc4396 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:38.213219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-0997f61e-c7c2-438f-924b-2ab4ea352ef5 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] [instance: 205d0485-cd73-4ab6-b52f-cc6e90382a0f] Going to try to terminate instance {{(pid=124717) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 18:52:38.357266 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-6877b585-7a13-4afa-98ff-6ea676fc4396 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:38.366463 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-6877b585-7a13-4afa-98ff-6ea676fc4396 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22" status: 200 len: 1367 microversion: 2.1 time: 0.181280 Jun 27 18:52:38.369125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 437/854] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:38 2022] GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:52:38.531240 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-0997f61e-c7c2-438f-924b-2ab4ea352ef5 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] 10.222.0.15 "DELETE /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f" status: 204 len: 0 microversion: 2.1 time: 0.359470 Jun 27 18:52:38.531945 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 418/855] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:52:38 2022] DELETE /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 18:52:38.540482 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-fc570d9c-84ee-4514-834d-32b18a6c3758 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:38.541346 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-fc570d9c-84ee-4514-834d-32b18a6c3758 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] [instance: 205d0485-cd73-4ab6-b52f-cc6e90382a0f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:38.547367 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fc570d9c-84ee-4514-834d-32b18a6c3758 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:38.547815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fc570d9c-84ee-4514-834d-32b18a6c3758 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:38.548791 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fc570d9c-84ee-4514-834d-32b18a6c3758 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:38.549232 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fc570d9c-84ee-4514-834d-32b18a6c3758 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:38.708004 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-fc570d9c-84ee-4514-834d-32b18a6c3758 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa14260afbce48ffbb851ff7065aea64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1847cdd8cc43d9b34490bd5e871e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:38.718472 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-fc570d9c-84ee-4514-834d-32b18a6c3758 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] 10.222.0.15 "GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f" status: 200 len: 1469 microversion: 2.1 time: 0.181962 Jun 27 18:52:38.719066 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 438/856] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:38 2022] GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f => generated 1469 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:39.302437 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-bac0ace7-9142-46a7-b5d0-abd83c2a6670 req-af142c73-f334-4b03-81ec-0e1ba41dd7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f070b8e2-2360-4dec-b274-cfa0a90a8a22", "tag": "7aba1775-3560-484b-ab57-2929895ae181"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:52:39.313531 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-bac0ace7-9142-46a7-b5d0-abd83c2a6670 req-af142c73-f334-4b03-81ec-0e1ba41dd7d3 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:39.315918 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-bac0ace7-9142-46a7-b5d0-abd83c2a6670 req-af142c73-f334-4b03-81ec-0e1ba41dd7d3 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:39.329922 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-bac0ace7-9142-46a7-b5d0-abd83c2a6670 req-af142c73-f334-4b03-81ec-0e1ba41dd7d3 service nova] Creating event network-changed:7aba1775-3560-484b-ab57-2929895ae181 for instance f070b8e2-2360-4dec-b274-cfa0a90a8a22 on hv-cinder-84460 Jun 27 18:52:39.335431 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-bac0ace7-9142-46a7-b5d0-abd83c2a6670 req-af142c73-f334-4b03-81ec-0e1ba41dd7d3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037360 Jun 27 18:52:39.336020 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 419/857] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:52:39.384556 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-c370191f-aeef-44c1-856c-0c614f195a62 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:39.388349 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-c370191f-aeef-44c1-856c-0c614f195a62 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:39.394916 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c370191f-aeef-44c1-856c-0c614f195a62 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:39.395374 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c370191f-aeef-44c1-856c-0c614f195a62 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:39.396155 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c370191f-aeef-44c1-856c-0c614f195a62 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:39.396591 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c370191f-aeef-44c1-856c-0c614f195a62 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:39.560497 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c370191f-aeef-44c1-856c-0c614f195a62 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:39.569041 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-c370191f-aeef-44c1-856c-0c614f195a62 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22" status: 200 len: 1367 microversion: 2.1 time: 0.188426 Jun 27 18:52:39.569792 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 439/858] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:39 2022] GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:39.736753 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0803b4f0-1631-457e-b079-ac1a190f4e89 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:39.738090 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-0803b4f0-1631-457e-b079-ac1a190f4e89 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] [instance: 205d0485-cd73-4ab6-b52f-cc6e90382a0f] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:39.746032 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0803b4f0-1631-457e-b079-ac1a190f4e89 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:39.746518 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0803b4f0-1631-457e-b079-ac1a190f4e89 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:39.747324 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0803b4f0-1631-457e-b079-ac1a190f4e89 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:39.747748 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0803b4f0-1631-457e-b079-ac1a190f4e89 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:39.964191 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-0803b4f0-1631-457e-b079-ac1a190f4e89 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa14260afbce48ffbb851ff7065aea64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1847cdd8cc43d9b34490bd5e871e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:39.972145 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-0803b4f0-1631-457e-b079-ac1a190f4e89 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] 10.222.0.15 "GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f" status: 200 len: 1469 microversion: 2.1 time: 0.240051 Jun 27 18:52:39.972720 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 420/859] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:39 2022] GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f => generated 1469 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:40.443153 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-78daec9b-cb35-4ba8-a41d-66e1c0c6e375 req-f0abe17a-fd7d-4fd3-9056-de6eb127a5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "205d0485-cd73-4ab6-b52f-cc6e90382a0f", "name": "network-vif-deleted", "tag": "37c6eeac-405c-4f2f-aa85-7697256e0a6a"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:52:40.452751 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-78daec9b-cb35-4ba8-a41d-66e1c0c6e375 req-f0abe17a-fd7d-4fd3-9056-de6eb127a5d5 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:40.453191 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-78daec9b-cb35-4ba8-a41d-66e1c0c6e375 req-f0abe17a-fd7d-4fd3-9056-de6eb127a5d5 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:40.465343 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-78daec9b-cb35-4ba8-a41d-66e1c0c6e375 req-f0abe17a-fd7d-4fd3-9056-de6eb127a5d5 service nova] Creating event network-vif-deleted:37c6eeac-405c-4f2f-aa85-7697256e0a6a for instance 205d0485-cd73-4ab6-b52f-cc6e90382a0f on hv-cinder-84460 Jun 27 18:52:40.470160 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-78daec9b-cb35-4ba8-a41d-66e1c0c6e375 req-f0abe17a-fd7d-4fd3-9056-de6eb127a5d5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032919 Jun 27 18:52:40.471006 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 440/860] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:52:40.585373 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-25c1703f-2fcb-49d7-9bfb-0f94d55dc90c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:40.585993 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-25c1703f-2fcb-49d7-9bfb-0f94d55dc90c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:40.593103 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-25c1703f-2fcb-49d7-9bfb-0f94d55dc90c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:40.593551 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-25c1703f-2fcb-49d7-9bfb-0f94d55dc90c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:40.594311 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-25c1703f-2fcb-49d7-9bfb-0f94d55dc90c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:40.594776 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-25c1703f-2fcb-49d7-9bfb-0f94d55dc90c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:40.734651 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-25c1703f-2fcb-49d7-9bfb-0f94d55dc90c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:40.747802 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-25c1703f-2fcb-49d7-9bfb-0f94d55dc90c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22" status: 200 len: 1367 microversion: 2.1 time: 0.166181 Jun 27 18:52:40.748382 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 421/861] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:40 2022] GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:40.989921 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-bb0672c1-5387-4f11-97e4-c35a0c58c9cc tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:40.990672 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-bb0672c1-5387-4f11-97e4-c35a0c58c9cc tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] [instance: 205d0485-cd73-4ab6-b52f-cc6e90382a0f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:40.997898 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bb0672c1-5387-4f11-97e4-c35a0c58c9cc tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:40.998350 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bb0672c1-5387-4f11-97e4-c35a0c58c9cc tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:40.999146 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bb0672c1-5387-4f11-97e4-c35a0c58c9cc tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:40.999580 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bb0672c1-5387-4f11-97e4-c35a0c58c9cc tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:41.063054 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-bb0672c1-5387-4f11-97e4-c35a0c58c9cc tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa14260afbce48ffbb851ff7065aea64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1847cdd8cc43d9b34490bd5e871e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:41.076454 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-bb0672c1-5387-4f11-97e4-c35a0c58c9cc tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] 10.222.0.15 "GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f" status: 200 len: 1299 microversion: 2.1 time: 0.090459 Jun 27 18:52:41.077209 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 441/862] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:40 2022] GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:41.764119 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-4312b9c8-0852-4a86-9686-c94efa993b43 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:41.764737 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-4312b9c8-0852-4a86-9686-c94efa993b43 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:41.771547 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4312b9c8-0852-4a86-9686-c94efa993b43 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:41.772180 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4312b9c8-0852-4a86-9686-c94efa993b43 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:41.772761 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4312b9c8-0852-4a86-9686-c94efa993b43 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:41.773195 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4312b9c8-0852-4a86-9686-c94efa993b43 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:41.919520 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-4312b9c8-0852-4a86-9686-c94efa993b43 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:41.927212 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-4312b9c8-0852-4a86-9686-c94efa993b43 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22" status: 200 len: 1367 microversion: 2.1 time: 0.166863 Jun 27 18:52:41.928110 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 422/863] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:41 2022] GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:42.096936 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7cea586a-f350-4d52-8007-75a1319aab28 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:42.097553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-7cea586a-f350-4d52-8007-75a1319aab28 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] [instance: 205d0485-cd73-4ab6-b52f-cc6e90382a0f] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:42.099525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=4 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:42.105664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7cea586a-f350-4d52-8007-75a1319aab28 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:42.106114 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7cea586a-f350-4d52-8007-75a1319aab28 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:42.106914 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7cea586a-f350-4d52-8007-75a1319aab28 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:42.107351 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7cea586a-f350-4d52-8007-75a1319aab28 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:42.120919 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-7cea586a-f350-4d52-8007-75a1319aab28 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] HTTP exception thrown: Instance 205d0485-cd73-4ab6-b52f-cc6e90382a0f could not be found. Jun 27 18:52:42.122557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7cea586a-f350-4d52-8007-75a1319aab28 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Request method failure captured: Jun 27 18:52:42.122557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f HTTP/1.1 Jun 27 18:52:42.122557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:52:42.122557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:52:42.122557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:52:42.122557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:52:42.122557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:52:42.122557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:52:42.122557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:52:42.122557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:52:42.122557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufxhFLIeiy-E1m-bVctV00ybnQYvSSE1ZIaECFomLYsJiD77UikuoFl27JwShhIRLPTCyPsRz-tuD3jK5FnCbF00pD7OyGxeanDPmy4f9DmKkaj3xctgsOpwFsMyh9ftCpINm8FI1Eq_ApJ3Y-bHtx4211bRvQLWElOyxDZ32mA2Wvk Jun 27 18:52:42.122557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:52:42.122557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:52:42.122557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:52:42.122557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:52:42.122557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:52:42.122557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:52:42.122557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: ac1847cdd8cc43d9b34490bd5e871e2b Jun 27 18:52:42.122557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-VolumesNegativeTest-1734001682 Jun 27 18:52:42.122557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:52:42.122557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:52:42.124215 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ac1847cdd8cc43d9b34490bd5e871e2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ac1847cdd8cc43d9b34490bd5e871e2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ac1847cdd8cc43d9b34490bd5e871e2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ac1847cdd8cc43d9b34490bd5e871e2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:52:42.124215 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-VolumesNegativeTest-1734001682 Jun 27 18:52:42.124215 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: ac1847cdd8cc43d9b34490bd5e871e2b Jun 27 18:52:42.124215 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-VolumesNegativeTest-1734001682 Jun 27 18:52:42.124215 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-VolumesNegativeTest-1734001682-project Jun 27 18:52:42.124215 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:52:42.124215 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:52:42.124215 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: aa14260afbce48ffbb851ff7065aea64 Jun 27 18:52:42.124215 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-VolumesNegativeTest-1734001682-project Jun 27 18:52:42.124215 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: > Jun 27 18:52:42.124215 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Instance 205d0485-cd73-4ab6-b52f-cc6e90382a0f could not be found. Jun 27 18:52:42.124215 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': '205d0485-cd73-4ab6-b52f-cc6e90382a0f'} Jun 27 18:52:42.125046 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:52:42.125046 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:42.125046 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:52:42.125046 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:52:42.125046 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:52:42.125046 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:52:42.125046 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:52:42.125046 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:52:42.125046 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:52:42.125046 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:52:42.125046 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 205d0485-cd73-4ab6-b52f-cc6e90382a0f could not be found. Jun 27 18:52:42.125046 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:42.125046 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:52:42.125046 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:42.125046 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:42.125046 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:52:42.125046 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:52:42.125046 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:52:42.125046 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:52:42.125046 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:52:42.126437 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:52:42.126437 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:52:42.126437 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:52:42.126437 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:52:42.126437 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:52:42.126437 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:52:42.126437 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:52:42.126437 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 205d0485-cd73-4ab6-b52f-cc6e90382a0f could not be found. Jun 27 18:52:42.126437 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:42.126437 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:52:42.126437 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:42.126437 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:52:42.126437 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:52:42.126437 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:52:42.126437 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:52:42.126437 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:52:42.126437 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 205d0485-cd73-4ab6-b52f-cc6e90382a0f could not be found. Jun 27 18:52:42.126437 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:52:42.127637 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7cea586a-f350-4d52-8007-75a1319aab28 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] Returning 404 to user: Instance 205d0485-cd73-4ab6-b52f-cc6e90382a0f could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:52:42.127637 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-7cea586a-f350-4d52-8007-75a1319aab28 tempest-VolumesNegativeTest-1734001682 tempest-VolumesNegativeTest-1734001682-project] 10.222.0.15 "GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f" status: 404 len: 111 microversion: 2.1 time: 0.030906 Jun 27 18:52:42.127637 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 442/864] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:42 2022] GET /compute/v2.1/servers/205d0485-cd73-4ab6-b52f-cc6e90382a0f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:52:42.944679 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-3f878351-ff1e-4070-9dd0-83fb2f74fc7e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:42.945325 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-3f878351-ff1e-4070-9dd0-83fb2f74fc7e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:42.954193 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3f878351-ff1e-4070-9dd0-83fb2f74fc7e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:42.954670 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3f878351-ff1e-4070-9dd0-83fb2f74fc7e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:42.955444 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3f878351-ff1e-4070-9dd0-83fb2f74fc7e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:42.955880 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3f878351-ff1e-4070-9dd0-83fb2f74fc7e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:43.097917 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-3f878351-ff1e-4070-9dd0-83fb2f74fc7e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:43.105510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-3f878351-ff1e-4070-9dd0-83fb2f74fc7e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22" status: 200 len: 1367 microversion: 2.1 time: 0.164935 Jun 27 18:52:43.106157 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 423/865] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:42 2022] GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:44.123561 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-58724003-2da5-4d2c-b888-e0f37e19f2ae tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:44.124171 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-58724003-2da5-4d2c-b888-e0f37e19f2ae tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:44.130731 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-58724003-2da5-4d2c-b888-e0f37e19f2ae tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:44.131179 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-58724003-2da5-4d2c-b888-e0f37e19f2ae tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:44.131926 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-58724003-2da5-4d2c-b888-e0f37e19f2ae tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:44.132359 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-58724003-2da5-4d2c-b888-e0f37e19f2ae tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:44.271506 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-58724003-2da5-4d2c-b888-e0f37e19f2ae tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:44.279481 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-58724003-2da5-4d2c-b888-e0f37e19f2ae tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22" status: 200 len: 1367 microversion: 2.1 time: 0.160507 Jun 27 18:52:44.280043 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 443/866] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:44 2022] GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:45.296835 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0061fb8d-1f8b-43e0-b6bb-5d97bfd1aece tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:45.297420 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-0061fb8d-1f8b-43e0-b6bb-5d97bfd1aece tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:45.299390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell0:SELECT=2 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:45.300321 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell0:SELECT=8 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:45.305622 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0061fb8d-1f8b-43e0-b6bb-5d97bfd1aece tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:45.306344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0061fb8d-1f8b-43e0-b6bb-5d97bfd1aece tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:45.307388 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0061fb8d-1f8b-43e0-b6bb-5d97bfd1aece tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:45.307993 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0061fb8d-1f8b-43e0-b6bb-5d97bfd1aece tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:45.483235 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-0061fb8d-1f8b-43e0-b6bb-5d97bfd1aece tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:45.490514 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-0061fb8d-1f8b-43e0-b6bb-5d97bfd1aece tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22" status: 200 len: 1367 microversion: 2.1 time: 0.197806 Jun 27 18:52:45.491093 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 424/867] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:45 2022] GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:46.508813 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-64e6a893-9e70-4c14-b8f5-5a2d7408fdb2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:46.510475 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-64e6a893-9e70-4c14-b8f5-5a2d7408fdb2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:46.517161 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-64e6a893-9e70-4c14-b8f5-5a2d7408fdb2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:46.517618 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-64e6a893-9e70-4c14-b8f5-5a2d7408fdb2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:46.518403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-64e6a893-9e70-4c14-b8f5-5a2d7408fdb2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:46.518973 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-64e6a893-9e70-4c14-b8f5-5a2d7408fdb2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:46.657420 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-64e6a893-9e70-4c14-b8f5-5a2d7408fdb2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:46.665288 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-64e6a893-9e70-4c14-b8f5-5a2d7408fdb2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22" status: 200 len: 1367 microversion: 2.1 time: 0.160205 Jun 27 18:52:46.667201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 444/868] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:46 2022] GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:46.945565 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-75bc1022-ce90-44c8-81ce-18a8ac02b5ef req-8b53e30c-98b9-4551-a056-f4cd94d6420f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f070b8e2-2360-4dec-b274-cfa0a90a8a22", "name": "network-vif-plugged", "status": "completed", "tag": "7aba1775-3560-484b-ab57-2929895ae181"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:52:46.956801 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-75bc1022-ce90-44c8-81ce-18a8ac02b5ef req-8b53e30c-98b9-4551-a056-f4cd94d6420f service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:46.957308 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-75bc1022-ce90-44c8-81ce-18a8ac02b5ef req-8b53e30c-98b9-4551-a056-f4cd94d6420f service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:46.969269 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-75bc1022-ce90-44c8-81ce-18a8ac02b5ef req-8b53e30c-98b9-4551-a056-f4cd94d6420f service nova] Creating event network-vif-plugged:7aba1775-3560-484b-ab57-2929895ae181 for instance f070b8e2-2360-4dec-b274-cfa0a90a8a22 on hv-cinder-84460 Jun 27 18:52:46.974250 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-75bc1022-ce90-44c8-81ce-18a8ac02b5ef req-8b53e30c-98b9-4551-a056-f4cd94d6420f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035378 Jun 27 18:52:46.974908 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 425/869] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:52:47.683682 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-ff21ebb4-34af-457e-b874-3cfda7da8202 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:47.684298 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-ff21ebb4-34af-457e-b874-3cfda7da8202 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:47.690825 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ff21ebb4-34af-457e-b874-3cfda7da8202 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:47.691269 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ff21ebb4-34af-457e-b874-3cfda7da8202 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:47.692023 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ff21ebb4-34af-457e-b874-3cfda7da8202 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:47.692453 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ff21ebb4-34af-457e-b874-3cfda7da8202 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:47.830464 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-ff21ebb4-34af-457e-b874-3cfda7da8202 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:47.832628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=100 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:47.839825 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-ff21ebb4-34af-457e-b874-3cfda7da8202 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22" status: 200 len: 1367 microversion: 2.1 time: 0.159846 Jun 27 18:52:47.840460 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 445/870] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:47 2022] GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:52:48.857699 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-f0c2f58f-d5c2-41d7-868b-58ca724f7b57 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:48.858539 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-f0c2f58f-d5c2-41d7-868b-58ca724f7b57 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:48.864726 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f0c2f58f-d5c2-41d7-868b-58ca724f7b57 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:48.865173 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f0c2f58f-d5c2-41d7-868b-58ca724f7b57 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:48.865935 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f0c2f58f-d5c2-41d7-868b-58ca724f7b57 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:48.866369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f0c2f58f-d5c2-41d7-868b-58ca724f7b57 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:49.030114 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-f0c2f58f-d5c2-41d7-868b-58ca724f7b57 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:49.037095 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-f0c2f58f-d5c2-41d7-868b-58ca724f7b57 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22" status: 200 len: 1367 microversion: 2.1 time: 0.184088 Jun 27 18:52:49.037681 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 426/871] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:48 2022] GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:50.053499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-fc7b7667-4e5f-489f-af61-b867cf9dd31c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:50.054118 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-fc7b7667-4e5f-489f-af61-b867cf9dd31c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:50.062103 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fc7b7667-4e5f-489f-af61-b867cf9dd31c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:50.062593 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fc7b7667-4e5f-489f-af61-b867cf9dd31c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:50.063370 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fc7b7667-4e5f-489f-af61-b867cf9dd31c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:50.063813 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fc7b7667-4e5f-489f-af61-b867cf9dd31c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:50.213756 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-fc7b7667-4e5f-489f-af61-b867cf9dd31c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:52:50.221284 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-fc7b7667-4e5f-489f-af61-b867cf9dd31c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22" status: 200 len: 1558 microversion: 2.1 time: 0.171641 Jun 27 18:52:50.221855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 446/872] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:52:50 2022] GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:52:50.239703 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-f414d808-bcad-4436-a269-2266c08ba482 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:52:50.240226 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-f414d808-bcad-4436-a269-2266c08ba482 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:52:50.247052 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f414d808-bcad-4436-a269-2266c08ba482 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:50.247506 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f414d808-bcad-4436-a269-2266c08ba482 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:50.248269 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f414d808-bcad-4436-a269-2266c08ba482 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:50.248734 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f414d808-bcad-4436-a269-2266c08ba482 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:50.344166 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-f414d808-bcad-4436-a269-2266c08ba482 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108304 Jun 27 18:52:50.344803 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 427/873] 10.222.0.15 () {58 vars in 1274 bytes} [Mon Jun 27 18:52:50 2022] GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:52:51.412373 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-49bf4ed3-1363-4e92-9476-fa1be94422d2 req-2d6100e4-17e5-4437-83aa-c87193597da0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f070b8e2-2360-4dec-b274-cfa0a90a8a22", "tag": "7aba1775-3560-484b-ab57-2929895ae181"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:52:51.424695 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-49bf4ed3-1363-4e92-9476-fa1be94422d2 req-2d6100e4-17e5-4437-83aa-c87193597da0 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:52:51.424695 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-49bf4ed3-1363-4e92-9476-fa1be94422d2 req-2d6100e4-17e5-4437-83aa-c87193597da0 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:52:51.435843 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-49bf4ed3-1363-4e92-9476-fa1be94422d2 req-2d6100e4-17e5-4437-83aa-c87193597da0 service nova] Creating event network-changed:7aba1775-3560-484b-ab57-2929895ae181 for instance f070b8e2-2360-4dec-b274-cfa0a90a8a22 on hv-cinder-84460 Jun 27 18:52:51.440875 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-49bf4ed3-1363-4e92-9476-fa1be94422d2 req-2d6100e4-17e5-4437-83aa-c87193597da0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032195 Jun 27 18:52:51.441492 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 447/874] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:53:18.071762 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-d997f57f-d101-4f5e-8429-c5d8a4c2ed4b tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Action: 'create', calling method: .version_select at 0x7f700fefb5e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1984899894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV82ZotROv6Mh/bbzDMFOUtZPozInqqzU25NLO+vlWHq9PXZtiXIUv/e0ooX0XK/sPmFqo6mYoGgOO49DFoSIdC7TFs6Sn2MtQVpPOrPUOPrbR3TQ2Rq8SoCeqmlu9/BQ=="}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:53:18.076834 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:18.077509 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:18.095932 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-d997f57f-d101-4f5e-8429-c5d8a4c2ed4b tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Getting quotas for project 22ff7f833172448fa47fbb796cd91c3d. Resources: {'key_pairs'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:53:18.105644 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-d997f57f-d101-4f5e-8429-c5d8a4c2ed4b tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Getting quotas for user 5d58cb1968f240d693e4c414869ffe44 and project 22ff7f833172448fa47fbb796cd91c3d. Resources: {'key_pairs'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:53:18.189277 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-d997f57f-d101-4f5e-8429-c5d8a4c2ed4b tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.121368 Jun 27 18:53:18.189886 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 428/875] 10.222.0.15 () {60 vars in 1158 bytes} [Mon Jun 27 18:53:18 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:53:18.314628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_api:SELECT=33 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:18.315387 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=9 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:18.319725 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a23ab5b6-cb99-4745-990b-1adb22d1f351 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1762703979", "imageRef": "d2bfaada-b904-4f4f-beaa-10efe5ef7656", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1984899894", "networks": [{"uuid": "0f23d9e7-d8d0-467f-9277-c9193896d702"}]}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:53:18.380959 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.network.neutron [None req-a23ab5b6-cb99-4745-990b-1adb22d1f351 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] validate_networks() for [('0f23d9e7-d8d0-467f-9277-c9193896d702', None, None, None, None, None)] {{(pid=124716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 18:53:18.730678 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-8524fdb0-e76f-4b0a-afec-830f47fc9796 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Action: 'create', calling method: .version_select at 0x7f700ff2baf0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1210628940", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGSDAWkg5F8Z4NA4eN1mkVV0dEHW/+FMR5+ZprRC+3GvLNMMn6AQCSE+J/soASCHoamo7YlKuluOmLUBnKzuGAQOPSNtio/LfdrbR1pQDrE+q+ywNMuYbfu/t3kT03waw=="}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:53:18.747309 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-8524fdb0-e76f-4b0a-afec-830f47fc9796 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Getting quotas for project 302e8c5b4c1f422fbd5cf5602a094d2e. Resources: {'key_pairs'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:53:18.752031 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-8524fdb0-e76f-4b0a-afec-830f47fc9796 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Getting quotas for user b10a90cce1b048d7bd55938811301ab4 and project 302e8c5b4c1f422fbd5cf5602a094d2e. Resources: {'key_pairs'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:53:18.865477 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-8524fdb0-e76f-4b0a-afec-830f47fc9796 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.359881 Jun 27 18:53:18.866431 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 429/876] 10.222.0.15 () {60 vars in 1158 bytes} [Mon Jun 27 18:53:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:53:19.093908 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-a23ab5b6-cb99-4745-990b-1adb22d1f351 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Flavor limits 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 18:53:19.095196 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-a23ab5b6-cb99-4745-990b-1adb22d1f351 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Image limits 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 18:53:19.095678 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-a23ab5b6-cb99-4745-990b-1adb22d1f351 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Flavor pref 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 18:53:19.096624 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-a23ab5b6-cb99-4745-990b-1adb22d1f351 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Image pref 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 18:53:19.097129 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-a23ab5b6-cb99-4745-990b-1adb22d1f351 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 18:53:19.108335 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a23ab5b6-cb99-4745-990b-1adb22d1f351 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:19.108783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a23ab5b6-cb99-4745-990b-1adb22d1f351 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:19.109578 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a23ab5b6-cb99-4745-990b-1adb22d1f351 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:19.110010 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a23ab5b6-cb99-4745-990b-1adb22d1f351 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:19.136429 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-a23ab5b6-cb99-4745-990b-1adb22d1f351 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Getting quotas for project 22ff7f833172448fa47fbb796cd91c3d. Resources: {'ram', 'cores', 'instances'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:53:19.141909 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-a23ab5b6-cb99-4745-990b-1adb22d1f351 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Getting quotas for user 5d58cb1968f240d693e4c414869ffe44 and project 22ff7f833172448fa47fbb796cd91c3d. Resources: {'ram', 'cores', 'instances'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:53:19.154855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a23ab5b6-cb99-4745-990b-1adb22d1f351 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Going to run 1 instances... {{(pid=124716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 18:53:19.157158 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a23ab5b6-cb99-4745-990b-1adb22d1f351 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d2bfaada-b904-4f4f-beaa-10efe5ef7656',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 18:53:19.312722 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a23ab5b6-cb99-4745-990b-1adb22d1f351 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.999636 Jun 27 18:53:19.313595 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 448/877] 10.222.0.15 () {60 vars in 1146 bytes} [Mon Jun 27 18:53:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 18:53:19.334814 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-fb9886da-2a0d-43f4-bcc5-1a0972cbc626 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:19.335532 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-fb9886da-2a0d-43f4-bcc5-1a0972cbc626 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:19.429066 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-fb9886da-2a0d-43f4-bcc5-1a0972cbc626 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:19.449028 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-fb9886da-2a0d-43f4-bcc5-1a0972cbc626 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1259 microversion: 2.1 time: 0.127249 Jun 27 18:53:19.451384 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 430/878] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:19 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1259 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:20.466034 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-cded5f19-fd72-4796-a6d6-b95cad7f5ca8 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:20.467499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-cded5f19-fd72-4796-a6d6-b95cad7f5ca8 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:20.523130 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-cded5f19-fd72-4796-a6d6-b95cad7f5ca8 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:20.531049 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-cded5f19-fd72-4796-a6d6-b95cad7f5ca8 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1259 microversion: 2.1 time: 0.069726 Jun 27 18:53:20.531597 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 449/879] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:20 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:21.547581 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-14f4507c-c6aa-4348-a8f8-182dade2e3a5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:21.548123 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-14f4507c-c6aa-4348-a8f8-182dade2e3a5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:21.555164 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-14f4507c-c6aa-4348-a8f8-182dade2e3a5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:21.555164 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-14f4507c-c6aa-4348-a8f8-182dade2e3a5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:21.557447 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-14f4507c-c6aa-4348-a8f8-182dade2e3a5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:21.557447 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-14f4507c-c6aa-4348-a8f8-182dade2e3a5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:21.645420 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-14f4507c-c6aa-4348-a8f8-182dade2e3a5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:21.653783 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-14f4507c-c6aa-4348-a8f8-182dade2e3a5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1319 microversion: 2.1 time: 0.110058 Jun 27 18:53:21.661000 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 431/880] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:21 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1319 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:22.674710 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-4c840701-d482-4312-bbfa-2b982a90b7b5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:22.676033 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-4c840701-d482-4312-bbfa-2b982a90b7b5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:22.697723 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4c840701-d482-4312-bbfa-2b982a90b7b5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:22.700550 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4c840701-d482-4312-bbfa-2b982a90b7b5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:22.704300 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4c840701-d482-4312-bbfa-2b982a90b7b5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:22.707104 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4c840701-d482-4312-bbfa-2b982a90b7b5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:23.069969 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-4c840701-d482-4312-bbfa-2b982a90b7b5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:23.095912 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-4c840701-d482-4312-bbfa-2b982a90b7b5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1359 microversion: 2.1 time: 0.428534 Jun 27 18:53:23.096486 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 450/881] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:22 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1359 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:24.113727 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-c691df98-6b0c-4910-9faf-36a0dc01bfcd tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:24.114358 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-c691df98-6b0c-4910-9faf-36a0dc01bfcd tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:24.130727 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c691df98-6b0c-4910-9faf-36a0dc01bfcd tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:24.135040 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c691df98-6b0c-4910-9faf-36a0dc01bfcd tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:24.135040 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c691df98-6b0c-4910-9faf-36a0dc01bfcd tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:24.135040 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c691df98-6b0c-4910-9faf-36a0dc01bfcd tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:24.496316 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-c691df98-6b0c-4910-9faf-36a0dc01bfcd tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:24.520089 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-c691df98-6b0c-4910-9faf-36a0dc01bfcd tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1359 microversion: 2.1 time: 0.410398 Jun 27 18:53:24.520871 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 432/882] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:24 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1359 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:24.632797 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-bc9fef41-3218-46ee-a8d8-e1caaa2dc31b req-8852ee22-fb88-4d42-8b0b-db44b0d9d15a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eefc02a7-6c4c-4eb1-9168-c5182c68714d", "tag": "c5c8f530-dd25-40c8-8902-f00d606c2ccc"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:53:24.685427 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-bc9fef41-3218-46ee-a8d8-e1caaa2dc31b req-8852ee22-fb88-4d42-8b0b-db44b0d9d15a service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:24.685427 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-bc9fef41-3218-46ee-a8d8-e1caaa2dc31b req-8852ee22-fb88-4d42-8b0b-db44b0d9d15a service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:24.699245 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-bc9fef41-3218-46ee-a8d8-e1caaa2dc31b req-8852ee22-fb88-4d42-8b0b-db44b0d9d15a service nova] Creating event network-changed:c5c8f530-dd25-40c8-8902-f00d606c2ccc for instance eefc02a7-6c4c-4eb1-9168-c5182c68714d on hv-cinder-84460 Jun 27 18:53:24.720261 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-bc9fef41-3218-46ee-a8d8-e1caaa2dc31b req-8852ee22-fb88-4d42-8b0b-db44b0d9d15a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097452 Jun 27 18:53:24.721221 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 451/883] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:53:25.537799 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-64cc48a9-6085-46ca-a51a-3a98fd31ed0f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:25.538444 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-64cc48a9-6085-46ca-a51a-3a98fd31ed0f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:25.545097 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-64cc48a9-6085-46ca-a51a-3a98fd31ed0f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:25.546264 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-64cc48a9-6085-46ca-a51a-3a98fd31ed0f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:25.547108 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-64cc48a9-6085-46ca-a51a-3a98fd31ed0f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:25.547566 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-64cc48a9-6085-46ca-a51a-3a98fd31ed0f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:25.707981 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-64cc48a9-6085-46ca-a51a-3a98fd31ed0f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:25.718926 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-64cc48a9-6085-46ca-a51a-3a98fd31ed0f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1359 microversion: 2.1 time: 0.182907 Jun 27 18:53:25.719686 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 433/884] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:25 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:26.736854 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f5dbe488-2bc4-450d-b02e-353c0423cec9 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:26.738139 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f5dbe488-2bc4-450d-b02e-353c0423cec9 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:26.746655 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f5dbe488-2bc4-450d-b02e-353c0423cec9 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:26.747035 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f5dbe488-2bc4-450d-b02e-353c0423cec9 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:26.748021 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f5dbe488-2bc4-450d-b02e-353c0423cec9 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:26.749030 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f5dbe488-2bc4-450d-b02e-353c0423cec9 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:26.901674 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f5dbe488-2bc4-450d-b02e-353c0423cec9 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:26.909196 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f5dbe488-2bc4-450d-b02e-353c0423cec9 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1359 microversion: 2.1 time: 0.176964 Jun 27 18:53:26.909771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 452/885] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:26 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:27.928626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a8296e62-d11e-406d-81da-e55df61bde3a tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:27.930054 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-a8296e62-d11e-406d-81da-e55df61bde3a tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:27.936842 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a8296e62-d11e-406d-81da-e55df61bde3a tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:27.937297 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a8296e62-d11e-406d-81da-e55df61bde3a tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:27.938079 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a8296e62-d11e-406d-81da-e55df61bde3a tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:27.938556 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a8296e62-d11e-406d-81da-e55df61bde3a tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:28.082244 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a8296e62-d11e-406d-81da-e55df61bde3a tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:28.090644 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-a8296e62-d11e-406d-81da-e55df61bde3a tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1359 microversion: 2.1 time: 0.166920 Jun 27 18:53:28.091326 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 434/886] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:27 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:28.300399 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-bebc931b-99e2-4496-acd2-058273d9d112 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:28.301599 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-bebc931b-99e2-4496-acd2-058273d9d112 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:28.309953 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bebc931b-99e2-4496-acd2-058273d9d112 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:28.310604 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bebc931b-99e2-4496-acd2-058273d9d112 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:28.311455 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bebc931b-99e2-4496-acd2-058273d9d112 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:28.311963 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bebc931b-99e2-4496-acd2-058273d9d112 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:28.336878 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-bebc931b-99e2-4496-acd2-058273d9d112 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22/ips" status: 200 len: 151 microversion: 2.1 time: 0.040571 Jun 27 18:53:28.337553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 453/887] 10.222.0.15 () {58 vars in 1247 bytes} [Mon Jun 27 18:53:28 2022] GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:53:29.120433 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0d10f948-dd05-47f5-aa25-d8b5159caba1 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:29.123394 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-0d10f948-dd05-47f5-aa25-d8b5159caba1 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:29.133659 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0d10f948-dd05-47f5-aa25-d8b5159caba1 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:29.134189 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0d10f948-dd05-47f5-aa25-d8b5159caba1 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:29.136020 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0d10f948-dd05-47f5-aa25-d8b5159caba1 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:29.136470 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0d10f948-dd05-47f5-aa25-d8b5159caba1 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:29.349424 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-0d10f948-dd05-47f5-aa25-d8b5159caba1 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:29.366013 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-0d10f948-dd05-47f5-aa25-d8b5159caba1 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1359 microversion: 2.1 time: 0.259768 Jun 27 18:53:29.367162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 435/888] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:29 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1359 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:30.384151 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-4fd80fe5-4289-4a32-8058-7bb8e5412213 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:30.385459 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-4fd80fe5-4289-4a32-8058-7bb8e5412213 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:30.391069 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=2 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:30.397541 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4fd80fe5-4289-4a32-8058-7bb8e5412213 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:30.398312 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4fd80fe5-4289-4a32-8058-7bb8e5412213 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:30.402638 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4fd80fe5-4289-4a32-8058-7bb8e5412213 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:30.402638 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4fd80fe5-4289-4a32-8058-7bb8e5412213 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:30.528722 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=8 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:30.554762 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-4fd80fe5-4289-4a32-8058-7bb8e5412213 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:30.565873 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-4fd80fe5-4289-4a32-8058-7bb8e5412213 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1359 microversion: 2.1 time: 0.184878 Jun 27 18:53:30.576109 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 454/889] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:30 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:31.211115 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-494631e0-f08f-4385-8bf2-c154fc238d30 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00d09eb9-b0c5-4a26-89ca-2932ccf117aa"}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:53:31.214127 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-494631e0-f08f-4385-8bf2-c154fc238d30 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:31.214786 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell0:SELECT=10 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:31.220156 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-494631e0-f08f-4385-8bf2-c154fc238d30 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:31.220610 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-494631e0-f08f-4385-8bf2-c154fc238d30 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:31.221408 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-494631e0-f08f-4385-8bf2-c154fc238d30 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:31.221845 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-494631e0-f08f-4385-8bf2-c154fc238d30 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:31.585239 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-74ee5822-d51b-4146-8846-1e7358600f44 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:31.586989 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-74ee5822-d51b-4146-8846-1e7358600f44 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:31.595447 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-74ee5822-d51b-4146-8846-1e7358600f44 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:31.600028 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-74ee5822-d51b-4146-8846-1e7358600f44 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:31.600028 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-74ee5822-d51b-4146-8846-1e7358600f44 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:31.600028 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-74ee5822-d51b-4146-8846-1e7358600f44 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:31.734939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-74ee5822-d51b-4146-8846-1e7358600f44 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:31.746761 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-74ee5822-d51b-4146-8846-1e7358600f44 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1359 microversion: 2.1 time: 0.166642 Jun 27 18:53:31.747361 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 455/890] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:31 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:53:32.461679 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-494631e0-f08f-4385-8bf2-c154fc238d30 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "POST /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.254454 Jun 27 18:53:32.464250 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 436/891] 10.222.0.15 () {60 vars in 1322 bytes} [Mon Jun 27 18:53:31 2022] POST /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22/os-volume_attachments => generated 194 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:53:32.764669 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-02ef844e-9267-4b56-8ff0-3c0efcfe54b7 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:32.765285 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-02ef844e-9267-4b56-8ff0-3c0efcfe54b7 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:32.771354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-02ef844e-9267-4b56-8ff0-3c0efcfe54b7 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:32.771819 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-02ef844e-9267-4b56-8ff0-3c0efcfe54b7 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:32.772559 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-02ef844e-9267-4b56-8ff0-3c0efcfe54b7 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:32.772991 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-02ef844e-9267-4b56-8ff0-3c0efcfe54b7 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:32.909307 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-02ef844e-9267-4b56-8ff0-3c0efcfe54b7 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:32.917294 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-02ef844e-9267-4b56-8ff0-3c0efcfe54b7 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1359 microversion: 2.1 time: 0.157925 Jun 27 18:53:32.917860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 456/892] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:32 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:33.935831 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-b1f213f3-8164-4baf-b147-87103ea8f362 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:33.936469 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-b1f213f3-8164-4baf-b147-87103ea8f362 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:33.942816 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b1f213f3-8164-4baf-b147-87103ea8f362 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:33.943266 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b1f213f3-8164-4baf-b147-87103ea8f362 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:33.944075 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b1f213f3-8164-4baf-b147-87103ea8f362 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:33.944504 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b1f213f3-8164-4baf-b147-87103ea8f362 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:34.075952 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-b1f213f3-8164-4baf-b147-87103ea8f362 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:34.083431 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-b1f213f3-8164-4baf-b147-87103ea8f362 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1359 microversion: 2.1 time: 0.153218 Jun 27 18:53:34.084002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 437/893] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:33 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:35.100291 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-60f6580b-3ecd-44f0-a30a-73cd1abc9f94 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:35.101035 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-60f6580b-3ecd-44f0-a30a-73cd1abc9f94 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:35.109069 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-60f6580b-3ecd-44f0-a30a-73cd1abc9f94 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:35.109513 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-60f6580b-3ecd-44f0-a30a-73cd1abc9f94 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:35.110290 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-60f6580b-3ecd-44f0-a30a-73cd1abc9f94 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:35.110758 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-60f6580b-3ecd-44f0-a30a-73cd1abc9f94 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:35.249086 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-60f6580b-3ecd-44f0-a30a-73cd1abc9f94 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:35.256655 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-60f6580b-3ecd-44f0-a30a-73cd1abc9f94 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1359 microversion: 2.1 time: 0.160350 Jun 27 18:53:35.257223 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 457/894] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:35 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:36.274359 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-93d1f256-cfa0-4b9c-90de-9287408aa1f8 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:36.274910 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-93d1f256-cfa0-4b9c-90de-9287408aa1f8 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:36.281425 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-93d1f256-cfa0-4b9c-90de-9287408aa1f8 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:36.281875 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-93d1f256-cfa0-4b9c-90de-9287408aa1f8 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:36.282655 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-93d1f256-cfa0-4b9c-90de-9287408aa1f8 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:36.283090 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-93d1f256-cfa0-4b9c-90de-9287408aa1f8 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:36.415410 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-93d1f256-cfa0-4b9c-90de-9287408aa1f8 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:36.423437 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-93d1f256-cfa0-4b9c-90de-9287408aa1f8 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1359 microversion: 2.1 time: 0.152990 Jun 27 18:53:36.424181 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 438/895] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:36 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:37.160326 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-7cd91266-85f7-4b57-aca3-63de8d1eb209 req-2075ed06-5c4c-47c5-bbc2-734f44968911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eefc02a7-6c4c-4eb1-9168-c5182c68714d", "name": "network-vif-plugged", "status": "completed", "tag": "c5c8f530-dd25-40c8-8902-f00d606c2ccc"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:53:37.169549 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-7cd91266-85f7-4b57-aca3-63de8d1eb209 req-2075ed06-5c4c-47c5-bbc2-734f44968911 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:37.169979 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-7cd91266-85f7-4b57-aca3-63de8d1eb209 req-2075ed06-5c4c-47c5-bbc2-734f44968911 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:37.180953 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-7cd91266-85f7-4b57-aca3-63de8d1eb209 req-2075ed06-5c4c-47c5-bbc2-734f44968911 service nova] Creating event network-vif-plugged:c5c8f530-dd25-40c8-8902-f00d606c2ccc for instance eefc02a7-6c4c-4eb1-9168-c5182c68714d on hv-cinder-84460 Jun 27 18:53:37.186249 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-7cd91266-85f7-4b57-aca3-63de8d1eb209 req-2075ed06-5c4c-47c5-bbc2-734f44968911 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029703 Jun 27 18:53:37.186863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 458/896] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:53:37.440943 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0286bd30-244a-4f1c-a6c6-c82ca45728fc tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:37.441559 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-0286bd30-244a-4f1c-a6c6-c82ca45728fc tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:37.447977 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0286bd30-244a-4f1c-a6c6-c82ca45728fc tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:37.449725 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0286bd30-244a-4f1c-a6c6-c82ca45728fc tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:37.449906 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0286bd30-244a-4f1c-a6c6-c82ca45728fc tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:37.450338 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0286bd30-244a-4f1c-a6c6-c82ca45728fc tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:37.641130 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-0286bd30-244a-4f1c-a6c6-c82ca45728fc tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:37.648400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-0286bd30-244a-4f1c-a6c6-c82ca45728fc tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1359 microversion: 2.1 time: 0.211313 Jun 27 18:53:37.648954 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 439/897] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:37 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:53:38.534333 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-eda4cae1-6a1d-4134-944e-1fdddfaafc7d tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1871211509", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1210628940", "security_groups": [{"name": "tempest-secgroup-smoke-1765541639"}], "block_device_mapping_v2": [{"uuid": "45376225-64b9-4d1f-a699-9639ef272105", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "258993d8-d320-41d5-9b9f-c929b6912ace"}]}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:53:38.643925 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.network.neutron [None req-eda4cae1-6a1d-4134-944e-1fdddfaafc7d tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] validate_networks() for [('258993d8-d320-41d5-9b9f-c929b6912ace', None, None, None, None, None)] {{(pid=124716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 18:53:38.665309 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-cf4ae092-4971-41a0-8bb8-079dcdf282da tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:38.666000 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-cf4ae092-4971-41a0-8bb8-079dcdf282da tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:38.672708 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cf4ae092-4971-41a0-8bb8-079dcdf282da tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:38.673146 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cf4ae092-4971-41a0-8bb8-079dcdf282da tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:38.673900 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cf4ae092-4971-41a0-8bb8-079dcdf282da tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:38.674329 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cf4ae092-4971-41a0-8bb8-079dcdf282da tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:38.876945 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-cf4ae092-4971-41a0-8bb8-079dcdf282da tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:38.884592 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-cf4ae092-4971-41a0-8bb8-079dcdf282da tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1359 microversion: 2.1 time: 0.223207 Jun 27 18:53:38.885166 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 440/898] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:38 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:53:39.085588 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-eda4cae1-6a1d-4134-944e-1fdddfaafc7d tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Flavor limits 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 18:53:39.086009 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-eda4cae1-6a1d-4134-944e-1fdddfaafc7d tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Image limits 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 18:53:39.086539 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-eda4cae1-6a1d-4134-944e-1fdddfaafc7d tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Flavor pref 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 18:53:39.086951 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-eda4cae1-6a1d-4134-944e-1fdddfaafc7d tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Image pref 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 18:53:39.087388 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-eda4cae1-6a1d-4134-944e-1fdddfaafc7d tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 18:53:39.096619 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-eda4cae1-6a1d-4134-944e-1fdddfaafc7d tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:39.097069 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-eda4cae1-6a1d-4134-944e-1fdddfaafc7d tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:39.100574 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-eda4cae1-6a1d-4134-944e-1fdddfaafc7d tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:39.100574 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-eda4cae1-6a1d-4134-944e-1fdddfaafc7d tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:39.116075 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-eda4cae1-6a1d-4134-944e-1fdddfaafc7d tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Getting quotas for project 302e8c5b4c1f422fbd5cf5602a094d2e. Resources: {'ram', 'cores', 'instances'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:53:39.121407 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-eda4cae1-6a1d-4134-944e-1fdddfaafc7d tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Getting quotas for user b10a90cce1b048d7bd55938811301ab4 and project 302e8c5b4c1f422fbd5cf5602a094d2e. Resources: {'ram', 'cores', 'instances'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:53:39.179406 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-eda4cae1-6a1d-4134-944e-1fdddfaafc7d tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Going to run 1 instances... {{(pid=124716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 18:53:39.181663 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-eda4cae1-6a1d-4134-944e-1fdddfaafc7d tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='45376225-64b9-4d1f-a699-9639ef272105',volume_size=None,volume_type=None)] {{(pid=124716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 18:53:39.557638 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-eda4cae1-6a1d-4134-944e-1fdddfaafc7d tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.028058 Jun 27 18:53:39.558445 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 459/899] 10.222.0.15 () {60 vars in 1146 bytes} [Mon Jun 27 18:53:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 18:53:39.569163 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-6c86e20a-a607-4d75-aac3-e1f07836e8ae tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:39.569787 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-6c86e20a-a607-4d75-aac3-e1f07836e8ae tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:39.626973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-6c86e20a-a607-4d75-aac3-e1f07836e8ae tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:39.633961 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-6c86e20a-a607-4d75-aac3-e1f07836e8ae tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 200 len: 1095 microversion: 2.1 time: 0.068801 Jun 27 18:53:39.634553 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 441/900] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:39 2022] GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:39.901129 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-6bc163d2-7b4e-4f04-ab11-61b36093e3ac tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:39.901772 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-6bc163d2-7b4e-4f04-ab11-61b36093e3ac tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:39.908443 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6bc163d2-7b4e-4f04-ab11-61b36093e3ac tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:39.908896 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6bc163d2-7b4e-4f04-ab11-61b36093e3ac tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:39.911855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6bc163d2-7b4e-4f04-ab11-61b36093e3ac tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:39.911855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6bc163d2-7b4e-4f04-ab11-61b36093e3ac tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:40.047553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-6bc163d2-7b4e-4f04-ab11-61b36093e3ac tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:40.058259 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-6bc163d2-7b4e-4f04-ab11-61b36093e3ac tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1549 microversion: 2.1 time: 0.161002 Jun 27 18:53:40.061381 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 460/901] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:39 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:40.074925 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-c7cb4edd-de3c-4924-94cd-636208c67954 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:40.075985 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-c7cb4edd-de3c-4924-94cd-636208c67954 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:40.082988 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c7cb4edd-de3c-4924-94cd-636208c67954 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:40.083436 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c7cb4edd-de3c-4924-94cd-636208c67954 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:40.084203 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c7cb4edd-de3c-4924-94cd-636208c67954 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:40.084644 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c7cb4edd-de3c-4924-94cd-636208c67954 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:40.216509 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-c7cb4edd-de3c-4924-94cd-636208c67954 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:40.223898 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-c7cb4edd-de3c-4924-94cd-636208c67954 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1549 microversion: 2.1 time: 0.152959 Jun 27 18:53:40.224457 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 442/902] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:40 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:40.239503 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-cf195a28-3ce3-48fe-8478-7c447aa56d90 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:40.243039 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-cf195a28-3ce3-48fe-8478-7c447aa56d90 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:40.243830 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-cf195a28-3ce3-48fe-8478-7c447aa56d90 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Searching by: {'deleted': False, 'project_id': '22ff7f833172448fa47fbb796cd91c3d'} {{(pid=124716) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 27 18:53:40.251397 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cf195a28-3ce3-48fe-8478-7c447aa56d90 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:40.251876 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cf195a28-3ce3-48fe-8478-7c447aa56d90 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:40.252683 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cf195a28-3ce3-48fe-8478-7c447aa56d90 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:40.253117 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cf195a28-3ce3-48fe-8478-7c447aa56d90 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:40.343543 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.multi_cell_list [None req-cf195a28-3ce3-48fe-8478-7c447aa56d90 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124716) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 27 18:53:40.437029 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-cf195a28-3ce3-48fe-8478-7c447aa56d90 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.201237 Jun 27 18:53:40.437621 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 461/903] 10.222.0.15 () {58 vars in 1124 bytes} [Mon Jun 27 18:53:40 2022] GET /compute/v2.1/servers => generated 343 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:53:40.448609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-5a9de79c-5765-4080-8fdf-02f301604118 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:40.449220 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-5a9de79c-5765-4080-8fdf-02f301604118 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:40.456118 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5a9de79c-5765-4080-8fdf-02f301604118 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:40.456570 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5a9de79c-5765-4080-8fdf-02f301604118 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:40.457344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5a9de79c-5765-4080-8fdf-02f301604118 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:40.457781 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-5a9de79c-5765-4080-8fdf-02f301604118 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:40.595896 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-5a9de79c-5765-4080-8fdf-02f301604118 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:40.603472 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-5a9de79c-5765-4080-8fdf-02f301604118 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1549 microversion: 2.1 time: 0.159365 Jun 27 18:53:40.604042 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 443/904] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:40 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:40.651561 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-0f921b6d-38d2-45b3-875d-9647f7b0e1e9 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:40.652466 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-0f921b6d-38d2-45b3-875d-9647f7b0e1e9 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:40.660095 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0f921b6d-38d2-45b3-875d-9647f7b0e1e9 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:40.660591 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0f921b6d-38d2-45b3-875d-9647f7b0e1e9 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:40.661365 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0f921b6d-38d2-45b3-875d-9647f7b0e1e9 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:40.661807 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0f921b6d-38d2-45b3-875d-9647f7b0e1e9 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:40.733855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-0f921b6d-38d2-45b3-875d-9647f7b0e1e9 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:40.741716 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-0f921b6d-38d2-45b3-875d-9647f7b0e1e9 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 200 len: 1145 microversion: 2.1 time: 0.094093 Jun 27 18:53:40.747267 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 462/905] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:40 2022] GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 1145 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:41.011183 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-4afa40ac-4ce9-430d-a454-3b13f90c6e74 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Action: 'create', calling method: .version_select at 0x7f700fe95280>, body: {"keypair": {"name": "tempest-keypair-625746239", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaV1scO/9WGQaiZxIYsvAbFqyEn04vsj2VsNP7U+NMQC1IHgZq8D81++Pt6VqhrgYKpyFx+jVQMLilL7JcgbhQPL8WRTlH949NeWD0Hx/qxU7igCymn3np6+fmYVAd2Bw=="}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:53:41.025165 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-4afa40ac-4ce9-430d-a454-3b13f90c6e74 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Getting quotas for project a981ae734b1e4993bb440918b1a74fe7. Resources: {'key_pairs'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:53:41.030052 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-4afa40ac-4ce9-430d-a454-3b13f90c6e74 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Getting quotas for user 48ac761d30de4fb49478a78ccf23ab92 and project a981ae734b1e4993bb440918b1a74fe7. Resources: {'key_pairs'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:53:41.127872 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-4afa40ac-4ce9-430d-a454-3b13f90c6e74 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.119421 Jun 27 18:53:41.127872 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 444/906] 10.222.0.15 () {60 vars in 1158 bytes} [Mon Jun 27 18:53:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:53:41.759303 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-235d2440-9ba2-45bb-bb3c-88fd0684be2c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:41.763466 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-235d2440-9ba2-45bb-bb3c-88fd0684be2c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:41.767991 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-235d2440-9ba2-45bb-bb3c-88fd0684be2c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:41.768757 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-235d2440-9ba2-45bb-bb3c-88fd0684be2c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:41.769571 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-235d2440-9ba2-45bb-bb3c-88fd0684be2c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:41.770199 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-235d2440-9ba2-45bb-bb3c-88fd0684be2c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:42.046354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-235d2440-9ba2-45bb-bb3c-88fd0684be2c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:42.052805 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-235d2440-9ba2-45bb-bb3c-88fd0684be2c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 200 len: 1201 microversion: 2.1 time: 0.297423 Jun 27 18:53:42.053381 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 463/907] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:41 2022] GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 1201 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:42.564223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-7c64750c-c252-4aa2-acc3-c13ec5bd69a9 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d99b9b29-4f4c-469d-8941-7456d796d4a2"}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:53:42.565325 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-7c64750c-c252-4aa2-acc3-c13ec5bd69a9 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:42.574295 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7c64750c-c252-4aa2-acc3-c13ec5bd69a9 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:42.576162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7c64750c-c252-4aa2-acc3-c13ec5bd69a9 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:42.576955 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7c64750c-c252-4aa2-acc3-c13ec5bd69a9 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:42.577390 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7c64750c-c252-4aa2-acc3-c13ec5bd69a9 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:43.073291 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-cf42863a-f970-4f9d-be51-d17fd14f01d7 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:43.074098 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-cf42863a-f970-4f9d-be51-d17fd14f01d7 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:43.081340 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cf42863a-f970-4f9d-be51-d17fd14f01d7 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:43.081791 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cf42863a-f970-4f9d-be51-d17fd14f01d7 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:43.082584 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cf42863a-f970-4f9d-be51-d17fd14f01d7 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:43.083022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cf42863a-f970-4f9d-be51-d17fd14f01d7 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:43.244610 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-cf42863a-f970-4f9d-be51-d17fd14f01d7 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:43.253348 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-cf42863a-f970-4f9d-be51-d17fd14f01d7 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 200 len: 1279 microversion: 2.1 time: 0.184163 Jun 27 18:53:43.263492 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 464/908] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:43 2022] GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 1279 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:53:43.428600 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-7c64750c-c252-4aa2-acc3-c13ec5bd69a9 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "POST /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.869299 Jun 27 18:53:43.429871 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 445/909] 10.222.0.15 () {60 vars in 1322 bytes} [Mon Jun 27 18:53:42 2022] POST /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d/os-volume_attachments => generated 194 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:53:43.634521 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-2bd557cf-a5dc-46db-8cf6-6fd589303611 req-6b6c0723-5a57-4408-8861-f9b3379c330c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "969bb23c-9265-497a-b68a-70193be0b3f1", "tag": "ea87b613-5cf7-4cd4-bbcb-2b7f807732c0"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:53:43.646845 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-2bd557cf-a5dc-46db-8cf6-6fd589303611 req-6b6c0723-5a57-4408-8861-f9b3379c330c service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:43.647412 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-2bd557cf-a5dc-46db-8cf6-6fd589303611 req-6b6c0723-5a57-4408-8861-f9b3379c330c service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:43.664939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-2bd557cf-a5dc-46db-8cf6-6fd589303611 req-6b6c0723-5a57-4408-8861-f9b3379c330c service nova] Creating event network-changed:ea87b613-5cf7-4cd4-bbcb-2b7f807732c0 for instance 969bb23c-9265-497a-b68a-70193be0b3f1 on hv-cinder-84460 Jun 27 18:53:43.671995 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-ac0be055-42c2-4a28-a9f1-fa7bc0bec291 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1234978388", "imageRef": "c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "580ec2de-be59-4921-adbe-91c7f9d3a376"}], "security_groups": [{"name": "tempest-securitygroup--2140736673"}], "key_name": "tempest-keypair-625746239", "user_data": "}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:53:43.686068 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-2bd557cf-a5dc-46db-8cf6-6fd589303611 req-6b6c0723-5a57-4408-8861-f9b3379c330c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052194 Jun 27 18:53:43.686068 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 465/910] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:53:43.869222 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.network.neutron [None req-ac0be055-42c2-4a28-a9f1-fa7bc0bec291 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] validate_networks() for [('580ec2de-be59-4921-adbe-91c7f9d3a376', None, None, None, None, None)] {{(pid=124717) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 18:53:44.271483 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-b5a705ce-4739-4a9c-b613-53901665c21a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:44.272330 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-b5a705ce-4739-4a9c-b613-53901665c21a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:44.279128 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b5a705ce-4739-4a9c-b613-53901665c21a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:44.279577 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b5a705ce-4739-4a9c-b613-53901665c21a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:44.280344 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b5a705ce-4739-4a9c-b613-53901665c21a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:44.280779 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b5a705ce-4739-4a9c-b613-53901665c21a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:44.788123 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-b5a705ce-4739-4a9c-b613-53901665c21a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:44.797014 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-b5a705ce-4739-4a9c-b613-53901665c21a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 200 len: 1267 microversion: 2.1 time: 0.530323 Jun 27 18:53:44.797821 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 466/911] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:44 2022] GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 1267 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:53:44.802870 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-ac0be055-42c2-4a28-a9f1-fa7bc0bec291 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Flavor limits 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 18:53:44.803990 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-ac0be055-42c2-4a28-a9f1-fa7bc0bec291 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Image limits 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 18:53:44.804470 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-ac0be055-42c2-4a28-a9f1-fa7bc0bec291 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Flavor pref 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 18:53:44.805126 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-ac0be055-42c2-4a28-a9f1-fa7bc0bec291 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Image pref 0:0:0 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 18:53:44.805616 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.virt.hardware [None req-ac0be055-42c2-4a28-a9f1-fa7bc0bec291 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 18:53:44.815874 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ac0be055-42c2-4a28-a9f1-fa7bc0bec291 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:44.816416 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ac0be055-42c2-4a28-a9f1-fa7bc0bec291 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:44.817309 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ac0be055-42c2-4a28-a9f1-fa7bc0bec291 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:44.817809 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ac0be055-42c2-4a28-a9f1-fa7bc0bec291 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:44.835483 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-ac0be055-42c2-4a28-a9f1-fa7bc0bec291 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Getting quotas for project a981ae734b1e4993bb440918b1a74fe7. Resources: {'ram', 'cores', 'instances'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:53:44.839529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-ac0be055-42c2-4a28-a9f1-fa7bc0bec291 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Getting quotas for user 48ac761d30de4fb49478a78ccf23ab92 and project a981ae734b1e4993bb440918b1a74fe7. Resources: {'ram', 'cores', 'instances'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:53:44.851323 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-ac0be055-42c2-4a28-a9f1-fa7bc0bec291 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Going to run 1 instances... {{(pid=124717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 18:53:44.853779 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-ac0be055-42c2-4a28-a9f1-fa7bc0bec291 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 18:53:44.966716 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-ac0be055-42c2-4a28-a9f1-fa7bc0bec291 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.300786 Jun 27 18:53:44.967741 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 446/912] 10.222.0.15 () {60 vars in 1146 bytes} [Mon Jun 27 18:53:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 1303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 18:53:44.977631 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7d3d1c12-c956-4e70-94ce-fd9087914e54 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:44.978256 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-7d3d1c12-c956-4e70-94ce-fd9087914e54 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:45.037310 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-7d3d1c12-c956-4e70-94ce-fd9087914e54 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:45.045461 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-7d3d1c12-c956-4e70-94ce-fd9087914e54 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2" status: 200 len: 1241 microversion: 2.1 time: 0.071847 Jun 27 18:53:45.046037 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 467/913] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:44 2022] GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:45.814756 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-cbdacf04-05ca-4e1f-92b6-00c5c03839c7 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:45.815413 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-cbdacf04-05ca-4e1f-92b6-00c5c03839c7 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:45.822572 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cbdacf04-05ca-4e1f-92b6-00c5c03839c7 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:45.822965 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cbdacf04-05ca-4e1f-92b6-00c5c03839c7 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:45.823722 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cbdacf04-05ca-4e1f-92b6-00c5c03839c7 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:45.824159 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cbdacf04-05ca-4e1f-92b6-00c5c03839c7 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:45.844496 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:45.955572 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-cbdacf04-05ca-4e1f-92b6-00c5c03839c7 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:45.963181 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-cbdacf04-05ca-4e1f-92b6-00c5c03839c7 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 200 len: 1267 microversion: 2.1 time: 0.152530 Jun 27 18:53:45.963790 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 447/914] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:45 2022] GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:53:46.062689 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7c8512c2-a401-4a6f-a8d4-7fd2cd75b560 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:46.063310 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-7c8512c2-a401-4a6f-a8d4-7fd2cd75b560 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:46.069843 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7c8512c2-a401-4a6f-a8d4-7fd2cd75b560 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:46.070299 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7c8512c2-a401-4a6f-a8d4-7fd2cd75b560 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:46.071090 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7c8512c2-a401-4a6f-a8d4-7fd2cd75b560 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:46.071524 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7c8512c2-a401-4a6f-a8d4-7fd2cd75b560 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:46.133283 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-7c8512c2-a401-4a6f-a8d4-7fd2cd75b560 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:46.141781 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-7c8512c2-a401-4a6f-a8d4-7fd2cd75b560 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2" status: 200 len: 1245 microversion: 2.1 time: 0.083081 Jun 27 18:53:46.142344 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 468/915] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:46 2022] GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:46.980910 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-cf0f37d8-0e68-42a5-8871-50de6450ed4f tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:46.982260 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-cf0f37d8-0e68-42a5-8871-50de6450ed4f tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:46.989043 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cf0f37d8-0e68-42a5-8871-50de6450ed4f tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:46.989498 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cf0f37d8-0e68-42a5-8871-50de6450ed4f tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:46.990265 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cf0f37d8-0e68-42a5-8871-50de6450ed4f tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:46.990731 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cf0f37d8-0e68-42a5-8871-50de6450ed4f tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:47.159260 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-5def1945-9959-4266-8fd3-db1b03412e21 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:47.159933 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-5def1945-9959-4266-8fd3-db1b03412e21 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:47.166590 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5def1945-9959-4266-8fd3-db1b03412e21 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:47.167052 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5def1945-9959-4266-8fd3-db1b03412e21 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:47.167830 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5def1945-9959-4266-8fd3-db1b03412e21 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:47.169969 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5def1945-9959-4266-8fd3-db1b03412e21 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:47.262617 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-cf0f37d8-0e68-42a5-8871-50de6450ed4f tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:47.270885 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-cf0f37d8-0e68-42a5-8871-50de6450ed4f tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 200 len: 1267 microversion: 2.1 time: 0.294149 Jun 27 18:53:47.271606 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 448/916] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:46 2022] GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 1267 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:47.353339 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-5def1945-9959-4266-8fd3-db1b03412e21 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:47.357939 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=100 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:47.362702 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-5def1945-9959-4266-8fd3-db1b03412e21 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2" status: 200 len: 1311 microversion: 2.1 time: 0.207884 Jun 27 18:53:47.363374 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 469/917] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:47 2022] GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2 => generated 1311 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:53:47.933915 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-437b4e08-d25b-4e0d-9b0a-7bf22d3486bf tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:47.935471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-437b4e08-d25b-4e0d-9b0a-7bf22d3486bf tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:47.937882 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-4bdeb08f-d487-4fe5-8dba-2fce5841c351 req-65d06bb2-e124-4602-a866-43dd5465eb2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a731689-b26b-4f41-a3d3-4d1a2ebff239", "tag": "d446f8e5-97d8-434f-9b91-31d20061c950"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:53:47.945053 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-437b4e08-d25b-4e0d-9b0a-7bf22d3486bf tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:47.946606 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-437b4e08-d25b-4e0d-9b0a-7bf22d3486bf tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:47.948360 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-437b4e08-d25b-4e0d-9b0a-7bf22d3486bf tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:47.949185 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-437b4e08-d25b-4e0d-9b0a-7bf22d3486bf tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:47.949310 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-4bdeb08f-d487-4fe5-8dba-2fce5841c351 req-65d06bb2-e124-4602-a866-43dd5465eb2c service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:47.949841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-4bdeb08f-d487-4fe5-8dba-2fce5841c351 req-65d06bb2-e124-4602-a866-43dd5465eb2c service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:47.962311 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-4bdeb08f-d487-4fe5-8dba-2fce5841c351 req-65d06bb2-e124-4602-a866-43dd5465eb2c service nova] Creating event network-changed:d446f8e5-97d8-434f-9b91-31d20061c950 for instance 2a731689-b26b-4f41-a3d3-4d1a2ebff239 on hv-cinder-84460 Jun 27 18:53:47.968630 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-4bdeb08f-d487-4fe5-8dba-2fce5841c351 req-65d06bb2-e124-4602-a866-43dd5465eb2c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034900 Jun 27 18:53:47.970050 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 470/918] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:53:47.984468 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-437b4e08-d25b-4e0d-9b0a-7bf22d3486bf tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Going to try to terminate instance {{(pid=124717) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 18:53:48.225329 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:48.290139 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-fda59fa0-4deb-4f7f-a2d3-281a75b060bc tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:48.291581 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-fda59fa0-4deb-4f7f-a2d3-281a75b060bc tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:48.300339 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fda59fa0-4deb-4f7f-a2d3-281a75b060bc tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:48.301316 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fda59fa0-4deb-4f7f-a2d3-281a75b060bc tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:48.306733 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-437b4e08-d25b-4e0d-9b0a-7bf22d3486bf tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 204 len: 0 microversion: 2.1 time: 0.376405 Jun 27 18:53:48.313434 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 449/919] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:53:47 2022] DELETE /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 18:53:48.313578 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fda59fa0-4deb-4f7f-a2d3-281a75b060bc tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:48.313578 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fda59fa0-4deb-4f7f-a2d3-281a75b060bc tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:48.316204 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-ef4242e5-c106-40e7-992e-812b719cc53f tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:48.317178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-ef4242e5-c106-40e7-992e-812b719cc53f tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:48.332071 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ef4242e5-c106-40e7-992e-812b719cc53f tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:48.332866 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ef4242e5-c106-40e7-992e-812b719cc53f tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:48.335375 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ef4242e5-c106-40e7-992e-812b719cc53f tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:48.335896 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ef4242e5-c106-40e7-992e-812b719cc53f tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:48.549418 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-fda59fa0-4deb-4f7f-a2d3-281a75b060bc tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:48.556002 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-ef4242e5-c106-40e7-992e-812b719cc53f tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:48.557277 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-fda59fa0-4deb-4f7f-a2d3-281a75b060bc tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 200 len: 1267 microversion: 2.1 time: 0.272103 Jun 27 18:53:48.557865 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 471/920] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:48 2022] GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 1267 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:53:48.563154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-1af2c1cc-3580-4ec5-8cb7-03d2a081ebf9 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:48.564145 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-1af2c1cc-3580-4ec5-8cb7-03d2a081ebf9 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:48.569585 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:48.571387 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1af2c1cc-3580-4ec5-8cb7-03d2a081ebf9 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:48.571906 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1af2c1cc-3580-4ec5-8cb7-03d2a081ebf9 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:48.572614 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1af2c1cc-3580-4ec5-8cb7-03d2a081ebf9 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:48.573051 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1af2c1cc-3580-4ec5-8cb7-03d2a081ebf9 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:48.573442 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-ef4242e5-c106-40e7-992e-812b719cc53f tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1569 microversion: 2.1 time: 0.261718 Jun 27 18:53:48.574451 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 450/921] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:48 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1569 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:53:48.708840 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-1af2c1cc-3580-4ec5-8cb7-03d2a081ebf9 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:48.716541 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-1af2c1cc-3580-4ec5-8cb7-03d2a081ebf9 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2" status: 200 len: 1367 microversion: 2.1 time: 0.157662 Jun 27 18:53:48.717333 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 472/922] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:48 2022] GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:49.574540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e42e1eb0-dc40-4073-840f-22a580e004c5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:49.575686 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e42e1eb0-dc40-4073-840f-22a580e004c5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:49.581724 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e42e1eb0-dc40-4073-840f-22a580e004c5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:49.582171 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e42e1eb0-dc40-4073-840f-22a580e004c5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:49.582969 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e42e1eb0-dc40-4073-840f-22a580e004c5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:49.583405 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e42e1eb0-dc40-4073-840f-22a580e004c5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:49.598650 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-1ea1ee45-6e5a-4fce-9ed2-d91aa717bffa tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:49.599262 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-1ea1ee45-6e5a-4fce-9ed2-d91aa717bffa tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:49.605560 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1ea1ee45-6e5a-4fce-9ed2-d91aa717bffa tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:49.606572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1ea1ee45-6e5a-4fce-9ed2-d91aa717bffa tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:49.608022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1ea1ee45-6e5a-4fce-9ed2-d91aa717bffa tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:49.608452 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1ea1ee45-6e5a-4fce-9ed2-d91aa717bffa tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:49.827386 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-e42e1eb0-dc40-4073-840f-22a580e004c5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:49.837939 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e42e1eb0-dc40-4073-840f-22a580e004c5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 200 len: 1267 microversion: 2.1 time: 0.267277 Jun 27 18:53:49.839897 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 451/923] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:49 2022] GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 1267 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:49.845574 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-befe2f30-95d8-40ba-a461-585bed1917b2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:49.846183 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-befe2f30-95d8-40ba-a461-585bed1917b2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:49.852934 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-befe2f30-95d8-40ba-a461-585bed1917b2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:49.853379 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-befe2f30-95d8-40ba-a461-585bed1917b2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:49.854275 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-befe2f30-95d8-40ba-a461-585bed1917b2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:49.854782 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-befe2f30-95d8-40ba-a461-585bed1917b2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:49.863674 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-1ea1ee45-6e5a-4fce-9ed2-d91aa717bffa tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:49.874829 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-1ea1ee45-6e5a-4fce-9ed2-d91aa717bffa tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1569 microversion: 2.1 time: 0.279960 Jun 27 18:53:49.875594 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 473/924] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:49 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1569 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:53:50.109719 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-befe2f30-95d8-40ba-a461-585bed1917b2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:50.118360 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-befe2f30-95d8-40ba-a461-585bed1917b2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2" status: 200 len: 1367 microversion: 2.1 time: 0.277320 Jun 27 18:53:50.118949 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 452/925] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:49 2022] GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2 => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:50.641704 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-d4d7314e-ea26-46ce-855b-e42a7b9dc62c req-710fcc0e-bd2c-4de9-9c9b-341a613ef986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c49e97a-ae62-46cd-addc-ac3558e6feb2", "tag": "693ee883-a693-4d53-b73e-4252479626ee"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:53:50.642144 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=4 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:50.648099 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-d4d7314e-ea26-46ce-855b-e42a7b9dc62c req-710fcc0e-bd2c-4de9-9c9b-341a613ef986 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:50.648555 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-d4d7314e-ea26-46ce-855b-e42a7b9dc62c req-710fcc0e-bd2c-4de9-9c9b-341a613ef986 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:50.665025 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-d4d7314e-ea26-46ce-855b-e42a7b9dc62c req-710fcc0e-bd2c-4de9-9c9b-341a613ef986 service nova] Creating event network-changed:693ee883-a693-4d53-b73e-4252479626ee for instance 0c49e97a-ae62-46cd-addc-ac3558e6feb2 on hv-cinder-84460 Jun 27 18:53:50.670991 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-d4d7314e-ea26-46ce-855b-e42a7b9dc62c req-710fcc0e-bd2c-4de9-9c9b-341a613ef986 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036465 Jun 27 18:53:50.671682 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 474/926] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:53:50.856238 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-c6a13027-8069-433d-8453-ee1a43d1becc tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:50.856849 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-c6a13027-8069-433d-8453-ee1a43d1becc tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:50.864040 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c6a13027-8069-433d-8453-ee1a43d1becc tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:50.864486 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c6a13027-8069-433d-8453-ee1a43d1becc tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:50.865243 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c6a13027-8069-433d-8453-ee1a43d1becc tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:50.865679 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c6a13027-8069-433d-8453-ee1a43d1becc tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:50.894190 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f5bd97b0-1fc6-444e-928d-340d47ed6a2c tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:50.896110 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f5bd97b0-1fc6-444e-928d-340d47ed6a2c tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:50.902951 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f5bd97b0-1fc6-444e-928d-340d47ed6a2c tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:50.903582 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f5bd97b0-1fc6-444e-928d-340d47ed6a2c tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:50.905028 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f5bd97b0-1fc6-444e-928d-340d47ed6a2c tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:50.905464 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f5bd97b0-1fc6-444e-928d-340d47ed6a2c tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:51.052543 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-c6a13027-8069-433d-8453-ee1a43d1becc tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:51.060666 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-c6a13027-8069-433d-8453-ee1a43d1becc tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 200 len: 1267 microversion: 2.1 time: 0.208086 Jun 27 18:53:51.061560 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 453/927] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:50 2022] GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:51.089240 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f5bd97b0-1fc6-444e-928d-340d47ed6a2c tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:51.097299 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f5bd97b0-1fc6-444e-928d-340d47ed6a2c tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1569 microversion: 2.1 time: 0.207791 Jun 27 18:53:51.097867 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 475/928] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:50 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:53:51.135884 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-feea93d9-387f-426c-acdf-7dfa59849aa7 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:51.136535 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-feea93d9-387f-426c-acdf-7dfa59849aa7 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:51.142536 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-feea93d9-387f-426c-acdf-7dfa59849aa7 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:51.142994 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-feea93d9-387f-426c-acdf-7dfa59849aa7 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:51.143757 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-feea93d9-387f-426c-acdf-7dfa59849aa7 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:51.144259 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-feea93d9-387f-426c-acdf-7dfa59849aa7 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:51.270424 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-feea93d9-387f-426c-acdf-7dfa59849aa7 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:51.277839 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-feea93d9-387f-426c-acdf-7dfa59849aa7 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2" status: 200 len: 1367 microversion: 2.1 time: 0.145853 Jun 27 18:53:51.278430 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 454/929] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:51 2022] GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:51.896869 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-1cb60acb-3c4f-43af-a9bd-c0aef0702858 req-d7dc3c62-d289-4711-9104-0c3094feb404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a731689-b26b-4f41-a3d3-4d1a2ebff239", "name": "network-vif-deleted", "tag": "d446f8e5-97d8-434f-9b91-31d20061c950"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:53:51.905688 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-1cb60acb-3c4f-43af-a9bd-c0aef0702858 req-d7dc3c62-d289-4711-9104-0c3094feb404 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:51.906136 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-1cb60acb-3c4f-43af-a9bd-c0aef0702858 req-d7dc3c62-d289-4711-9104-0c3094feb404 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:51.917162 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-1cb60acb-3c4f-43af-a9bd-c0aef0702858 req-d7dc3c62-d289-4711-9104-0c3094feb404 service nova] Creating event network-vif-deleted:d446f8e5-97d8-434f-9b91-31d20061c950 for instance 2a731689-b26b-4f41-a3d3-4d1a2ebff239 on hv-cinder-84460 Jun 27 18:53:51.923055 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-1cb60acb-3c4f-43af-a9bd-c0aef0702858 req-d7dc3c62-d289-4711-9104-0c3094feb404 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030114 Jun 27 18:53:51.923699 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 476/930] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:53:52.078054 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-16299dcf-3dcc-42bd-94d4-94987aae2c66 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:52.078702 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-16299dcf-3dcc-42bd-94d4-94987aae2c66 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:52.087899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-16299dcf-3dcc-42bd-94d4-94987aae2c66 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:52.089092 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-16299dcf-3dcc-42bd-94d4-94987aae2c66 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:52.090214 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-16299dcf-3dcc-42bd-94d4-94987aae2c66 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:52.090858 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-16299dcf-3dcc-42bd-94d4-94987aae2c66 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:52.114937 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-84f5bc39-c55e-4ac1-a4c6-8e1ab20d296f tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:52.115917 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-84f5bc39-c55e-4ac1-a4c6-8e1ab20d296f tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:52.123131 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-84f5bc39-c55e-4ac1-a4c6-8e1ab20d296f tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:52.123842 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-84f5bc39-c55e-4ac1-a4c6-8e1ab20d296f tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:52.124802 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-84f5bc39-c55e-4ac1-a4c6-8e1ab20d296f tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:52.125398 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-84f5bc39-c55e-4ac1-a4c6-8e1ab20d296f tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:52.313951 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-84f5bc39-c55e-4ac1-a4c6-8e1ab20d296f tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:52.322458 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-84f5bc39-c55e-4ac1-a4c6-8e1ab20d296f tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1220 microversion: 2.1 time: 0.211464 Jun 27 18:53:52.323158 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 477/931] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:52 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1220 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:53:52.333960 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-baa5a8e5-38af-40bb-8641-fd4fc2be4fc2 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:52.334853 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-baa5a8e5-38af-40bb-8641-fd4fc2be4fc2 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:52.342853 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-baa5a8e5-38af-40bb-8641-fd4fc2be4fc2 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:52.343315 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-baa5a8e5-38af-40bb-8641-fd4fc2be4fc2 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:52.344082 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-baa5a8e5-38af-40bb-8641-fd4fc2be4fc2 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:52.344520 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-baa5a8e5-38af-40bb-8641-fd4fc2be4fc2 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:52.458727 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-16299dcf-3dcc-42bd-94d4-94987aae2c66 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:52.466737 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-16299dcf-3dcc-42bd-94d4-94987aae2c66 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 200 len: 1267 microversion: 2.1 time: 0.393113 Jun 27 18:53:52.467536 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 455/932] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:52 2022] GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 1267 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:52.472420 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-fc89ca1e-ca70-4c9b-ad83-dfe8581bf880 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:52.473269 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-fc89ca1e-ca70-4c9b-ad83-dfe8581bf880 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:52.479425 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-fc89ca1e-ca70-4c9b-ad83-dfe8581bf880 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:52.479941 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-fc89ca1e-ca70-4c9b-ad83-dfe8581bf880 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:52.480727 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-fc89ca1e-ca70-4c9b-ad83-dfe8581bf880 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:52.481174 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-fc89ca1e-ca70-4c9b-ad83-dfe8581bf880 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:52.503414 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-baa5a8e5-38af-40bb-8641-fd4fc2be4fc2 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:52.511634 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-baa5a8e5-38af-40bb-8641-fd4fc2be4fc2 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1595 microversion: 2.1 time: 0.185364 Jun 27 18:53:52.512246 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 478/933] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:52 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1595 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:52.618151 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-fc89ca1e-ca70-4c9b-ad83-dfe8581bf880 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:52.626372 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-fc89ca1e-ca70-4c9b-ad83-dfe8581bf880 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2" status: 200 len: 1367 microversion: 2.1 time: 0.157503 Jun 27 18:53:52.627166 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 456/934] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:52 2022] GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:53.340294 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-8f714bfd-38d0-4ecb-8130-0d758c2fb533 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:53.341007 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-8f714bfd-38d0-4ecb-8130-0d758c2fb533 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:53.347341 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8f714bfd-38d0-4ecb-8130-0d758c2fb533 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:53.347863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8f714bfd-38d0-4ecb-8130-0d758c2fb533 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:53.348706 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8f714bfd-38d0-4ecb-8130-0d758c2fb533 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:53.349228 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8f714bfd-38d0-4ecb-8130-0d758c2fb533 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:53.421088 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-8f714bfd-38d0-4ecb-8130-0d758c2fb533 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49ccbcfbd48642aabd74d789b1875dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61866ab089f04e9abfab3f6ce58cf6b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:53.429032 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-8f714bfd-38d0-4ecb-8130-0d758c2fb533 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 200 len: 1220 microversion: 2.1 time: 0.092726 Jun 27 18:53:53.436993 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 479/935] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:53 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:53.484186 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-d821e761-4701-4882-8114-79193bd6a1fc tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:53.485423 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-d821e761-4701-4882-8114-79193bd6a1fc tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:53.492345 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d821e761-4701-4882-8114-79193bd6a1fc tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:53.492805 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d821e761-4701-4882-8114-79193bd6a1fc tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:53.493617 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d821e761-4701-4882-8114-79193bd6a1fc tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:53.494104 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d821e761-4701-4882-8114-79193bd6a1fc tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:53.637592 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-d821e761-4701-4882-8114-79193bd6a1fc tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:53.644100 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-5cdfd522-d4e7-420f-b5b4-a5f0917452ae tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:53.644737 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-5cdfd522-d4e7-420f-b5b4-a5f0917452ae tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:53.649523 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-d821e761-4701-4882-8114-79193bd6a1fc tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 200 len: 1267 microversion: 2.1 time: 0.169060 Jun 27 18:53:53.650767 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 457/936] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:53 2022] GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:53.656405 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5cdfd522-d4e7-420f-b5b4-a5f0917452ae tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:53.657226 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5cdfd522-d4e7-420f-b5b4-a5f0917452ae tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:53.658575 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5cdfd522-d4e7-420f-b5b4-a5f0917452ae tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:53.660166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5cdfd522-d4e7-420f-b5b4-a5f0917452ae tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:53.805259 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-5cdfd522-d4e7-420f-b5b4-a5f0917452ae tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:53.813614 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-5cdfd522-d4e7-420f-b5b4-a5f0917452ae tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2" status: 200 len: 1367 microversion: 2.1 time: 0.173353 Jun 27 18:53:53.814598 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 480/937] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:53 2022] GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:54.446449 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-60723228-8286-4267-b427-4e4e6ed7d839 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:54.447069 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-60723228-8286-4267-b427-4e4e6ed7d839 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] [instance: 2a731689-b26b-4f41-a3d3-4d1a2ebff239] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:54.453818 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-60723228-8286-4267-b427-4e4e6ed7d839 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:54.454266 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-60723228-8286-4267-b427-4e4e6ed7d839 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:54.455070 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-60723228-8286-4267-b427-4e4e6ed7d839 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:54.455516 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-60723228-8286-4267-b427-4e4e6ed7d839 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:54.469148 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-60723228-8286-4267-b427-4e4e6ed7d839 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] HTTP exception thrown: Instance 2a731689-b26b-4f41-a3d3-4d1a2ebff239 could not be found. Jun 27 18:53:54.470854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-60723228-8286-4267-b427-4e4e6ed7d839 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Request method failure captured: Jun 27 18:53:54.470854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 HTTP/1.1 Jun 27 18:53:54.470854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 18:53:54.470854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 18:53:54.470854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 18:53:54.470854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 0 Jun 27 18:53:54.470854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 18:53:54.470854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 18:53:54.470854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 18:53:54.470854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 18:53:54.470854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiuft5fhZ_lIPOc19tZZ-6BGDwL3fJyXLduc5u1RY1hZ3BtayBpQohnJkIjxGO0u1vn-7Wflu1QImXU7pIYEnWTG0DFe_cw4zSVH_W5cu2nHq8SNJDKceU80UcBTKbls9jauVB8ykWR3TzeD-5teMFlAC3oaMyRCoHJ5RODlfth4iEuGw Jun 27 18:53:54.470854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 18:53:54.470854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 18:53:54.470854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 18:53:54.470854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 18:53:54.470854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 18:53:54.470854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 18:53:54.470854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: 61866ab089f04e9abfab3f6ce58cf6b8 Jun 27 18:53:54.470854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-TestShelveInstance-1596099895 Jun 27 18:53:54.470854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 18:53:54.470854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 18:53:54.472563 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/61866ab089f04e9abfab3f6ce58cf6b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/61866ab089f04e9abfab3f6ce58cf6b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_61866ab089f04e9abfab3f6ce58cf6b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/61866ab089f04e9abfab3f6ce58cf6b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:53:54.472563 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-TestShelveInstance-1596099895 Jun 27 18:53:54.472563 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: 61866ab089f04e9abfab3f6ce58cf6b8 Jun 27 18:53:54.472563 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-TestShelveInstance-1596099895 Jun 27 18:53:54.472563 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-TestShelveInstance-1596099895-project Jun 27 18:53:54.472563 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 18:53:54.472563 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 18:53:54.472563 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: 49ccbcfbd48642aabd74d789b1875dd3 Jun 27 18:53:54.472563 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-TestShelveInstance-1596099895-project Jun 27 18:53:54.472563 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: > Jun 27 18:53:54.472563 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Instance 2a731689-b26b-4f41-a3d3-4d1a2ebff239 could not be found. Jun 27 18:53:54.472563 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'id': '2a731689-b26b-4f41-a3d3-4d1a2ebff239'} Jun 27 18:53:54.473400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:53:54.473400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:53:54.473400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:53:54.473400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:53:54.473400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:53:54.473400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:53:54.473400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:53:54.473400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:53:54.473400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:53:54.473400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:53:54.473400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a731689-b26b-4f41-a3d3-4d1a2ebff239 could not be found. Jun 27 18:53:54.473400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:53:54.473400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:53:54.473400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:53:54.473400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:53:54.473400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:53:54.473400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:53:54.473400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:53:54.473400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:53:54.473400 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:53:54.474827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:53:54.474827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:53:54.474827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:53:54.474827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:53:54.474827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:53:54.474827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:53:54.474827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:53:54.474827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a731689-b26b-4f41-a3d3-4d1a2ebff239 could not be found. Jun 27 18:53:54.474827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:53:54.474827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:53:54.474827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:53:54.474827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:53:54.474827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:53:54.474827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:53:54.474827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:53:54.474827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:53:54.474827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a731689-b26b-4f41-a3d3-4d1a2ebff239 could not be found. Jun 27 18:53:54.474827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:53:54.475971 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-60723228-8286-4267-b427-4e4e6ed7d839 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Returning 404 to user: Instance 2a731689-b26b-4f41-a3d3-4d1a2ebff239 could not be found. {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:53:54.475971 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-60723228-8286-4267-b427-4e4e6ed7d839 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239" status: 404 len: 111 microversion: 2.1 time: 0.029761 Jun 27 18:53:54.475971 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 458/938] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:54 2022] GET /compute/v2.1/servers/2a731689-b26b-4f41-a3d3-4d1a2ebff239 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:53:54.669604 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-c1f01885-d01a-4d6b-a558-219ebd597bae tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:54.670721 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-c1f01885-d01a-4d6b-a558-219ebd597bae tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:54.687620 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-470b06fc-6043-4313-87f5-a285463a5d01 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] Calling method '.version_select at 0x7f700ff2ff70>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:54.694145 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c1f01885-d01a-4d6b-a558-219ebd597bae tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:54.694632 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c1f01885-d01a-4d6b-a558-219ebd597bae tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:54.695441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c1f01885-d01a-4d6b-a558-219ebd597bae tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:54.695839 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c1f01885-d01a-4d6b-a558-219ebd597bae tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:54.782110 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-470b06fc-6043-4313-87f5-a285463a5d01 tempest-TestShelveInstance-1596099895 tempest-TestShelveInstance-1596099895-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1706456981" status: 202 len: 0 microversion: 2.1 time: 0.099591 Jun 27 18:53:54.782988 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 459/939] 10.222.0.15 () {58 vars in 1253 bytes} [Mon Jun 27 18:53:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1706456981 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:53:54.804537 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-50447a04-ef7f-4545-9f81-d5935aced317 req-a3bacd89-5641-4d12-ae91-c01e89134861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eefc02a7-6c4c-4eb1-9168-c5182c68714d", "tag": "c5c8f530-dd25-40c8-8902-f00d606c2ccc"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:53:54.818923 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-50447a04-ef7f-4545-9f81-d5935aced317 req-a3bacd89-5641-4d12-ae91-c01e89134861 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:54.819368 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-50447a04-ef7f-4545-9f81-d5935aced317 req-a3bacd89-5641-4d12-ae91-c01e89134861 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:54.827375 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell0:SELECT=2 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:54.842352 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-50447a04-ef7f-4545-9f81-d5935aced317 req-a3bacd89-5641-4d12-ae91-c01e89134861 service nova] Creating event network-changed:c5c8f530-dd25-40c8-8902-f00d606c2ccc for instance eefc02a7-6c4c-4eb1-9168-c5182c68714d on hv-cinder-84460 Jun 27 18:53:54.854175 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-50447a04-ef7f-4545-9f81-d5935aced317 req-a3bacd89-5641-4d12-ae91-c01e89134861 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052566 Jun 27 18:53:54.855770 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 460/940] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:53:54.877932 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-f4723ebc-28bd-4ac9-ac03-f3a9b61c1ebc tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:54.878682 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-f4723ebc-28bd-4ac9-ac03-f3a9b61c1ebc tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:54.882721 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell0:SELECT=12 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:54.885718 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c1f01885-d01a-4d6b-a558-219ebd597bae tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:54.886955 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f4723ebc-28bd-4ac9-ac03-f3a9b61c1ebc tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:54.887405 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f4723ebc-28bd-4ac9-ac03-f3a9b61c1ebc tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:54.891841 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f4723ebc-28bd-4ac9-ac03-f3a9b61c1ebc tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:54.892699 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f4723ebc-28bd-4ac9-ac03-f3a9b61c1ebc tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:54.897893 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-c1f01885-d01a-4d6b-a558-219ebd597bae tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 200 len: 1267 microversion: 2.1 time: 0.232787 Jun 27 18:53:54.912394 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 481/941] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:54 2022] GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 1267 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:55.270048 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-f4723ebc-28bd-4ac9-ac03-f3a9b61c1ebc tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:55.277914 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-f4723ebc-28bd-4ac9-ac03-f3a9b61c1ebc tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2" status: 200 len: 1367 microversion: 2.1 time: 0.420908 Jun 27 18:53:55.278617 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 461/942] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:54 2022] GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2 => generated 1367 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:55.590334 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-bd79464e-8e78-4d51-bf05-d0620e5a8674 req-2410405e-10f1-482a-91ef-16630f3d2429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "969bb23c-9265-497a-b68a-70193be0b3f1", "name": "network-vif-plugged", "status": "completed", "tag": "ea87b613-5cf7-4cd4-bbcb-2b7f807732c0"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:53:55.594340 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=8 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:55.600150 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-bd79464e-8e78-4d51-bf05-d0620e5a8674 req-2410405e-10f1-482a-91ef-16630f3d2429 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:55.600705 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-bd79464e-8e78-4d51-bf05-d0620e5a8674 req-2410405e-10f1-482a-91ef-16630f3d2429 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:55.613376 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-bd79464e-8e78-4d51-bf05-d0620e5a8674 req-2410405e-10f1-482a-91ef-16630f3d2429 service nova] Creating event network-vif-plugged:ea87b613-5cf7-4cd4-bbcb-2b7f807732c0 for instance 969bb23c-9265-497a-b68a-70193be0b3f1 on hv-cinder-84460 Jun 27 18:53:55.618669 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-bd79464e-8e78-4d51-bf05-d0620e5a8674 req-2410405e-10f1-482a-91ef-16630f3d2429 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032715 Jun 27 18:53:55.619408 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 482/943] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:53:55.919537 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-fd39dd77-d916-4b37-9843-51d34c07e52a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:55.920806 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-fd39dd77-d916-4b37-9843-51d34c07e52a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:55.927668 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-fd39dd77-d916-4b37-9843-51d34c07e52a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:55.928310 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-fd39dd77-d916-4b37-9843-51d34c07e52a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:55.929236 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-fd39dd77-d916-4b37-9843-51d34c07e52a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:55.929859 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-fd39dd77-d916-4b37-9843-51d34c07e52a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:56.298698 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-8bbcad9e-2d16-49d7-8270-62356e09c6bd tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:56.299277 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-fd39dd77-d916-4b37-9843-51d34c07e52a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:56.299401 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-8bbcad9e-2d16-49d7-8270-62356e09c6bd tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:56.306560 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8bbcad9e-2d16-49d7-8270-62356e09c6bd tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:56.306560 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8bbcad9e-2d16-49d7-8270-62356e09c6bd tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:56.307379 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8bbcad9e-2d16-49d7-8270-62356e09c6bd tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:56.307499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8bbcad9e-2d16-49d7-8270-62356e09c6bd tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:56.312688 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-fd39dd77-d916-4b37-9843-51d34c07e52a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 200 len: 1267 microversion: 2.1 time: 0.397037 Jun 27 18:53:56.314007 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 462/944] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:55 2022] GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 1267 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:56.617059 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-8bbcad9e-2d16-49d7-8270-62356e09c6bd tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:56.629272 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-8bbcad9e-2d16-49d7-8270-62356e09c6bd tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2" status: 200 len: 1367 microversion: 2.1 time: 0.336565 Jun 27 18:53:56.630161 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 483/945] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:56 2022] GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2 => generated 1367 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:53:57.331463 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-cc752991-bb7f-4f30-85e3-72f6b0bdf0a5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:57.332095 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-cc752991-bb7f-4f30-85e3-72f6b0bdf0a5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:57.338842 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cc752991-bb7f-4f30-85e3-72f6b0bdf0a5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:57.342090 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cc752991-bb7f-4f30-85e3-72f6b0bdf0a5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:57.342090 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cc752991-bb7f-4f30-85e3-72f6b0bdf0a5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:57.342090 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cc752991-bb7f-4f30-85e3-72f6b0bdf0a5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:57.643649 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-bd5c1824-aefb-4955-a8db-17e1a2ea4853 req-e2508c6c-dba5-4c1d-a994-d20da5d54854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c49e97a-ae62-46cd-addc-ac3558e6feb2", "name": "network-vif-plugged", "status": "completed", "tag": "693ee883-a693-4d53-b73e-4252479626ee"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:53:57.654819 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-bd5c1824-aefb-4955-a8db-17e1a2ea4853 req-e2508c6c-dba5-4c1d-a994-d20da5d54854 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:57.655366 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-bd5c1824-aefb-4955-a8db-17e1a2ea4853 req-e2508c6c-dba5-4c1d-a994-d20da5d54854 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:57.667027 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-bd5c1824-aefb-4955-a8db-17e1a2ea4853 req-e2508c6c-dba5-4c1d-a994-d20da5d54854 service nova] Creating event network-vif-plugged:693ee883-a693-4d53-b73e-4252479626ee for instance 0c49e97a-ae62-46cd-addc-ac3558e6feb2 on hv-cinder-84460 Jun 27 18:53:57.673527 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-bd5c1824-aefb-4955-a8db-17e1a2ea4853 req-e2508c6c-dba5-4c1d-a994-d20da5d54854 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034815 Jun 27 18:53:57.674215 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 484/946] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:53:57.679324 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-be808330-92a2-4b57-8e9b-ca835d89cf33 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:57.680032 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-be808330-92a2-4b57-8e9b-ca835d89cf33 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:57.687369 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-be808330-92a2-4b57-8e9b-ca835d89cf33 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:57.687811 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-be808330-92a2-4b57-8e9b-ca835d89cf33 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:57.689113 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-be808330-92a2-4b57-8e9b-ca835d89cf33 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:57.689553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-be808330-92a2-4b57-8e9b-ca835d89cf33 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:57.942820 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-cc752991-bb7f-4f30-85e3-72f6b0bdf0a5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:57.957305 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-cc752991-bb7f-4f30-85e3-72f6b0bdf0a5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 200 len: 1267 microversion: 2.1 time: 0.629135 Jun 27 18:53:57.958915 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 463/947] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:57 2022] GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 1267 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:57.969778 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-be808330-92a2-4b57-8e9b-ca835d89cf33 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:57.980560 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-be808330-92a2-4b57-8e9b-ca835d89cf33 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2" status: 200 len: 1367 microversion: 2.1 time: 0.305135 Jun 27 18:53:57.981381 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 485/948] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:57 2022] GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2 => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:58.478494 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0dad6ef5-4e32-470b-9bd6-a830f901cb0d tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1984299551"}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:53:58.479294 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-0dad6ef5-4e32-470b-9bd6-a830f901cb0d tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:58.488479 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0dad6ef5-4e32-470b-9bd6-a830f901cb0d tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:58.488955 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0dad6ef5-4e32-470b-9bd6-a830f901cb0d tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:58.489749 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0dad6ef5-4e32-470b-9bd6-a830f901cb0d tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:58.490190 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0dad6ef5-4e32-470b-9bd6-a830f901cb0d tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:58.626642 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.network.security_group_api [None req-0dad6ef5-4e32-470b-9bd6-a830f901cb0d tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Adding security group 916371a6-db3f-4e97-84b5-74d2f9430d85 to port c5c8f530-dd25-40c8-8902-f00d606c2ccc Jun 27 18:53:58.976574 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-dda0713d-db63-423b-80a6-45edfc2e34d2 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:58.977953 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-dda0713d-db63-423b-80a6-45edfc2e34d2 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:58.985864 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-dda0713d-db63-423b-80a6-45edfc2e34d2 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:58.986500 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-dda0713d-db63-423b-80a6-45edfc2e34d2 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:58.987590 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-dda0713d-db63-423b-80a6-45edfc2e34d2 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:58.988057 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-dda0713d-db63-423b-80a6-45edfc2e34d2 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:59.100207 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-0dad6ef5-4e32-470b-9bd6-a830f901cb0d tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "POST /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d/action" status: 202 len: 0 microversion: 2.1 time: 0.625740 Jun 27 18:53:59.101638 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 464/949] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Jun 27 18:53:58 2022] POST /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d/action => generated 0 bytes in 628 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:53:59.107494 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a35f57c0-a007-4e1b-83f7-a5f5186490f8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:59.108144 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-a35f57c0-a007-4e1b-83f7-a5f5186490f8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:59.129064 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a35f57c0-a007-4e1b-83f7-a5f5186490f8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:59.129521 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a35f57c0-a007-4e1b-83f7-a5f5186490f8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:59.130531 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a35f57c0-a007-4e1b-83f7-a5f5186490f8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:59.131365 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a35f57c0-a007-4e1b-83f7-a5f5186490f8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:59.137238 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:59.358410 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-dda0713d-db63-423b-80a6-45edfc2e34d2 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:59.379814 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a35f57c0-a007-4e1b-83f7-a5f5186490f8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:59.384658 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-dda0713d-db63-423b-80a6-45edfc2e34d2 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 200 len: 1455 microversion: 2.1 time: 0.412504 Jun 27 18:53:59.389102 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-a35f57c0-a007-4e1b-83f7-a5f5186490f8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2" status: 200 len: 1367 microversion: 2.1 time: 0.286151 Jun 27 18:53:59.394124 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 465/950] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:59 2022] GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2 => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:59.397643 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-518c620f-94bd-44f5-b44a-acbc0acac6aa req-1bcbf30d-95b8-4f16-94bd-198cd008275d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eefc02a7-6c4c-4eb1-9168-c5182c68714d", "tag": "c5c8f530-dd25-40c8-8902-f00d606c2ccc"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:53:59.400783 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 486/951] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:58 2022] GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 1455 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:53:59.405948 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-0841df94-b6ea-48b1-97e2-9d28ca45009d tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:59.406591 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-0841df94-b6ea-48b1-97e2-9d28ca45009d tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:59.408254 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-518c620f-94bd-44f5-b44a-acbc0acac6aa req-1bcbf30d-95b8-4f16-94bd-198cd008275d service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:59.409233 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-518c620f-94bd-44f5-b44a-acbc0acac6aa req-1bcbf30d-95b8-4f16-94bd-198cd008275d service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:59.414274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0841df94-b6ea-48b1-97e2-9d28ca45009d tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:59.415029 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0841df94-b6ea-48b1-97e2-9d28ca45009d tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:59.415989 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0841df94-b6ea-48b1-97e2-9d28ca45009d tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:59.416593 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-0841df94-b6ea-48b1-97e2-9d28ca45009d tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:59.425819 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-518c620f-94bd-44f5-b44a-acbc0acac6aa req-1bcbf30d-95b8-4f16-94bd-198cd008275d service nova] Creating event network-changed:c5c8f530-dd25-40c8-8902-f00d606c2ccc for instance eefc02a7-6c4c-4eb1-9168-c5182c68714d on hv-cinder-84460 Jun 27 18:53:59.434029 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-518c620f-94bd-44f5-b44a-acbc0acac6aa req-1bcbf30d-95b8-4f16-94bd-198cd008275d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040153 Jun 27 18:53:59.434957 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 466/952] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:53:59.445883 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-cc9fa87f-fd40-420a-90bc-d0700e238f2c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:53:59.446843 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-cc9fa87f-fd40-420a-90bc-d0700e238f2c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:53:59.456878 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cc9fa87f-fd40-420a-90bc-d0700e238f2c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:59.458222 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cc9fa87f-fd40-420a-90bc-d0700e238f2c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:59.459208 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cc9fa87f-fd40-420a-90bc-d0700e238f2c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:53:59.459922 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cc9fa87f-fd40-420a-90bc-d0700e238f2c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:53:59.703776 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-0841df94-b6ea-48b1-97e2-9d28ca45009d tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:59.718655 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-0841df94-b6ea-48b1-97e2-9d28ca45009d tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1761 microversion: 2.1 time: 0.316494 Jun 27 18:53:59.720079 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 487/953] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:59 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1761 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:53:59.806960 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-cc9fa87f-fd40-420a-90bc-d0700e238f2c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:53:59.820802 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-cc9fa87f-fd40-420a-90bc-d0700e238f2c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 200 len: 1455 microversion: 2.1 time: 0.380632 Jun 27 18:53:59.823582 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 467/954] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:53:59 2022] GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 1455 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:00.409345 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-3facdef6-326c-4d4e-b7f2-1500264fa1c1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:00.410865 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-3facdef6-326c-4d4e-b7f2-1500264fa1c1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:00.417637 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3facdef6-326c-4d4e-b7f2-1500264fa1c1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:00.418090 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3facdef6-326c-4d4e-b7f2-1500264fa1c1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:00.419112 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3facdef6-326c-4d4e-b7f2-1500264fa1c1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:00.419564 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3facdef6-326c-4d4e-b7f2-1500264fa1c1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:00.727839 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3facdef6-326c-4d4e-b7f2-1500264fa1c1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:00.736018 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-3facdef6-326c-4d4e-b7f2-1500264fa1c1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2" status: 200 len: 1558 microversion: 2.1 time: 0.330591 Jun 27 18:54:00.755185 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-dfd03999-b037-474e-95dd-2e9482e8a80d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:00.755185 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-dfd03999-b037-474e-95dd-2e9482e8a80d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:00.761432 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-dfd03999-b037-474e-95dd-2e9482e8a80d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:00.761874 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-dfd03999-b037-474e-95dd-2e9482e8a80d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:00.762675 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-dfd03999-b037-474e-95dd-2e9482e8a80d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:00.763113 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-dfd03999-b037-474e-95dd-2e9482e8a80d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:00.764459 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 488/955] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:00 2022] GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2 => generated 1558 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:00.851988 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-dfd03999-b037-474e-95dd-2e9482e8a80d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101979 Jun 27 18:54:00.852748 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 468/956] 10.222.0.15 () {58 vars in 1274 bytes} [Mon Jun 27 18:54:00 2022] GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:54:02.686817 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-e6c6c602-fb00-4f09-ad7b-623cc9505a6e req-bb8ca75f-67d5-41f0-82a9-1443ef17acbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c49e97a-ae62-46cd-addc-ac3558e6feb2", "tag": "693ee883-a693-4d53-b73e-4252479626ee"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:54:02.696142 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-e6c6c602-fb00-4f09-ad7b-623cc9505a6e req-bb8ca75f-67d5-41f0-82a9-1443ef17acbf service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:02.696592 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-e6c6c602-fb00-4f09-ad7b-623cc9505a6e req-bb8ca75f-67d5-41f0-82a9-1443ef17acbf service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:02.708872 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-e6c6c602-fb00-4f09-ad7b-623cc9505a6e req-bb8ca75f-67d5-41f0-82a9-1443ef17acbf service nova] Creating event network-changed:693ee883-a693-4d53-b73e-4252479626ee for instance 0c49e97a-ae62-46cd-addc-ac3558e6feb2 on hv-cinder-84460 Jun 27 18:54:02.713840 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-e6c6c602-fb00-4f09-ad7b-623cc9505a6e req-bb8ca75f-67d5-41f0-82a9-1443ef17acbf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031247 Jun 27 18:54:02.714628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 489/957] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:54:04.751722 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-eca1891c-9331-4652-a118-a461360d191a req-971a94dc-4f3c-4898-9f1c-1479cdb2a817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "969bb23c-9265-497a-b68a-70193be0b3f1", "tag": "ea87b613-5cf7-4cd4-bbcb-2b7f807732c0"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:54:04.760453 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-eca1891c-9331-4652-a118-a461360d191a req-971a94dc-4f3c-4898-9f1c-1479cdb2a817 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:04.760893 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-eca1891c-9331-4652-a118-a461360d191a req-971a94dc-4f3c-4898-9f1c-1479cdb2a817 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:04.773453 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-eca1891c-9331-4652-a118-a461360d191a req-971a94dc-4f3c-4898-9f1c-1479cdb2a817 service nova] Creating event network-changed:ea87b613-5cf7-4cd4-bbcb-2b7f807732c0 for instance 969bb23c-9265-497a-b68a-70193be0b3f1 on hv-cinder-84460 Jun 27 18:54:04.778637 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-eca1891c-9331-4652-a118-a461360d191a req-971a94dc-4f3c-4898-9f1c-1479cdb2a817 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032556 Jun 27 18:54:04.779865 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 469/958] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:54:21.289776 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_api:SELECT=35 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:54:21.290522 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=96 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:54:21.294738 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-9d4ff497-78cb-4b31-95ee-2c929ffc37d7 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:54:21.295763 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-9d4ff497-78cb-4b31-95ee-2c929ffc37d7 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:21.302465 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9d4ff497-78cb-4b31-95ee-2c929ffc37d7 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:21.302911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9d4ff497-78cb-4b31-95ee-2c929ffc37d7 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:21.303706 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9d4ff497-78cb-4b31-95ee-2c929ffc37d7 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:21.304203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9d4ff497-78cb-4b31-95ee-2c929ffc37d7 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:21.505467 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-9d4ff497-78cb-4b31-95ee-2c929ffc37d7 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "POST /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d/action" status: 202 len: 0 microversion: 2.1 time: 0.217494 Jun 27 18:54:21.506281 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 490/959] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Jun 27 18:54:21 2022] POST /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:54:21.512142 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:54:21.512900 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=18 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:54:21.516921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-7b1acc42-171a-453b-9b31-8765939d5aad tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:21.517625 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-7b1acc42-171a-453b-9b31-8765939d5aad tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:21.523838 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7b1acc42-171a-453b-9b31-8765939d5aad tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:21.524289 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7b1acc42-171a-453b-9b31-8765939d5aad tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:21.525055 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7b1acc42-171a-453b-9b31-8765939d5aad tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:21.525488 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7b1acc42-171a-453b-9b31-8765939d5aad tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:21.708798 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-7b1acc42-171a-453b-9b31-8765939d5aad tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:21.717291 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-7b1acc42-171a-453b-9b31-8765939d5aad tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1753 microversion: 2.1 time: 0.206773 Jun 27 18:54:21.717859 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 470/960] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:21 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1753 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:22.736689 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7fa8cf03-c295-4a8e-a745-d38697a8299f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:22.738052 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-7fa8cf03-c295-4a8e-a745-d38697a8299f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:22.744394 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7fa8cf03-c295-4a8e-a745-d38697a8299f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:22.744842 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7fa8cf03-c295-4a8e-a745-d38697a8299f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:22.745610 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7fa8cf03-c295-4a8e-a745-d38697a8299f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:22.746048 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7fa8cf03-c295-4a8e-a745-d38697a8299f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:22.887059 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-7fa8cf03-c295-4a8e-a745-d38697a8299f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:22.895927 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-7fa8cf03-c295-4a8e-a745-d38697a8299f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1758 microversion: 2.1 time: 0.163906 Jun 27 18:54:22.896494 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 491/961] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:22 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:23.913461 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-87881d25-9df1-450c-8e0c-795d2573d7d6 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:23.914068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-87881d25-9df1-450c-8e0c-795d2573d7d6 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:23.920476 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-87881d25-9df1-450c-8e0c-795d2573d7d6 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:23.920914 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-87881d25-9df1-450c-8e0c-795d2573d7d6 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:23.921666 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-87881d25-9df1-450c-8e0c-795d2573d7d6 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:23.922093 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-87881d25-9df1-450c-8e0c-795d2573d7d6 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:24.066529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-87881d25-9df1-450c-8e0c-795d2573d7d6 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:24.074494 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-87881d25-9df1-450c-8e0c-795d2573d7d6 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1758 microversion: 2.1 time: 0.165183 Jun 27 18:54:24.075057 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 471/962] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:23 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:25.091971 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-321bbee0-6d9b-4358-9bed-45bdcd714b70 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:25.092587 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-321bbee0-6d9b-4358-9bed-45bdcd714b70 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:25.100347 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-321bbee0-6d9b-4358-9bed-45bdcd714b70 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:25.100896 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-321bbee0-6d9b-4358-9bed-45bdcd714b70 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:25.101787 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-321bbee0-6d9b-4358-9bed-45bdcd714b70 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:25.102285 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-321bbee0-6d9b-4358-9bed-45bdcd714b70 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:25.243195 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-321bbee0-6d9b-4358-9bed-45bdcd714b70 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:25.251273 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-321bbee0-6d9b-4358-9bed-45bdcd714b70 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1758 microversion: 2.1 time: 0.163333 Jun 27 18:54:25.251828 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 492/963] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:25 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:26.268243 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-d30bc5bd-9b3e-4de4-a8d3-f37886ffbda5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:26.268770 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-d30bc5bd-9b3e-4de4-a8d3-f37886ffbda5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:26.275932 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d30bc5bd-9b3e-4de4-a8d3-f37886ffbda5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:26.276378 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d30bc5bd-9b3e-4de4-a8d3-f37886ffbda5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:26.277171 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d30bc5bd-9b3e-4de4-a8d3-f37886ffbda5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:26.277608 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d30bc5bd-9b3e-4de4-a8d3-f37886ffbda5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:26.421743 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-d30bc5bd-9b3e-4de4-a8d3-f37886ffbda5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:26.430201 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-d30bc5bd-9b3e-4de4-a8d3-f37886ffbda5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1758 microversion: 2.1 time: 0.165895 Jun 27 18:54:26.430797 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 472/964] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:26 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:27.447019 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-471d862f-ec57-458e-96a5-11d7f2aec1ce tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:27.447632 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-471d862f-ec57-458e-96a5-11d7f2aec1ce tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:27.454085 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-471d862f-ec57-458e-96a5-11d7f2aec1ce tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:27.454582 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-471d862f-ec57-458e-96a5-11d7f2aec1ce tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:27.455349 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-471d862f-ec57-458e-96a5-11d7f2aec1ce tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:27.455787 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-471d862f-ec57-458e-96a5-11d7f2aec1ce tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:27.598931 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-471d862f-ec57-458e-96a5-11d7f2aec1ce tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:27.606949 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-471d862f-ec57-458e-96a5-11d7f2aec1ce tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1758 microversion: 2.1 time: 0.163841 Jun 27 18:54:27.607510 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 493/965] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:27 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:28.624420 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-2f85d660-1e75-46f2-8306-faa56ab7736c tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:28.625046 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-2f85d660-1e75-46f2-8306-faa56ab7736c tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:28.632223 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2f85d660-1e75-46f2-8306-faa56ab7736c tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:28.632783 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2f85d660-1e75-46f2-8306-faa56ab7736c tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:28.633548 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2f85d660-1e75-46f2-8306-faa56ab7736c tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:28.633987 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2f85d660-1e75-46f2-8306-faa56ab7736c tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:28.777817 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-2f85d660-1e75-46f2-8306-faa56ab7736c tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:28.786374 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-2f85d660-1e75-46f2-8306-faa56ab7736c tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1758 microversion: 2.1 time: 0.166103 Jun 27 18:54:28.786954 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 473/966] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:28 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:29.803378 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-03db9ed6-9c06-41f8-8759-8c3336da4d86 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:29.803998 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-03db9ed6-9c06-41f8-8759-8c3336da4d86 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:29.810467 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-03db9ed6-9c06-41f8-8759-8c3336da4d86 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:29.810915 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-03db9ed6-9c06-41f8-8759-8c3336da4d86 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:29.811670 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-03db9ed6-9c06-41f8-8759-8c3336da4d86 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:29.812104 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-03db9ed6-9c06-41f8-8759-8c3336da4d86 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:29.954573 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-03db9ed6-9c06-41f8-8759-8c3336da4d86 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:29.962760 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-03db9ed6-9c06-41f8-8759-8c3336da4d86 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1758 microversion: 2.1 time: 0.163355 Jun 27 18:54:29.963327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 494/967] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:29 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:30.979748 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-ed499181-26d8-47e0-a038-e85712688bf2 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:30.980361 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-ed499181-26d8-47e0-a038-e85712688bf2 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:30.986823 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ed499181-26d8-47e0-a038-e85712688bf2 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:30.987270 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ed499181-26d8-47e0-a038-e85712688bf2 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:30.988280 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ed499181-26d8-47e0-a038-e85712688bf2 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:30.988715 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ed499181-26d8-47e0-a038-e85712688bf2 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:31.135725 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-ed499181-26d8-47e0-a038-e85712688bf2 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:31.143691 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-ed499181-26d8-47e0-a038-e85712688bf2 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1758 microversion: 2.1 time: 0.167839 Jun 27 18:54:31.145366 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 474/968] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:30 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:32.162572 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-e17ca262-1acf-4dad-bdee-81998c5dee72 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:32.163184 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-e17ca262-1acf-4dad-bdee-81998c5dee72 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:32.169331 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e17ca262-1acf-4dad-bdee-81998c5dee72 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:32.169785 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e17ca262-1acf-4dad-bdee-81998c5dee72 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:32.170580 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e17ca262-1acf-4dad-bdee-81998c5dee72 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:32.171024 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e17ca262-1acf-4dad-bdee-81998c5dee72 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:32.315664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-e17ca262-1acf-4dad-bdee-81998c5dee72 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:32.323951 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-e17ca262-1acf-4dad-bdee-81998c5dee72 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1758 microversion: 2.1 time: 0.166146 Jun 27 18:54:32.324519 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 495/969] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:32 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:33.341148 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-8ce5ca56-75fd-473d-9b1e-f1dd81f20229 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:33.341783 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-8ce5ca56-75fd-473d-9b1e-f1dd81f20229 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:33.349038 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8ce5ca56-75fd-473d-9b1e-f1dd81f20229 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:33.349483 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8ce5ca56-75fd-473d-9b1e-f1dd81f20229 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:33.350247 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8ce5ca56-75fd-473d-9b1e-f1dd81f20229 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:33.350713 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8ce5ca56-75fd-473d-9b1e-f1dd81f20229 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:33.495569 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-8ce5ca56-75fd-473d-9b1e-f1dd81f20229 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:33.503987 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-8ce5ca56-75fd-473d-9b1e-f1dd81f20229 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1758 microversion: 2.1 time: 0.166613 Jun 27 18:54:33.504662 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 475/970] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:33 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:34.521839 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-f8cf859b-007a-4442-9d35-98526c0fab60 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:34.522482 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-f8cf859b-007a-4442-9d35-98526c0fab60 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:34.528946 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f8cf859b-007a-4442-9d35-98526c0fab60 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:34.529396 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f8cf859b-007a-4442-9d35-98526c0fab60 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:34.530163 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f8cf859b-007a-4442-9d35-98526c0fab60 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:34.530630 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-f8cf859b-007a-4442-9d35-98526c0fab60 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:34.674030 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-f8cf859b-007a-4442-9d35-98526c0fab60 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:34.682120 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-f8cf859b-007a-4442-9d35-98526c0fab60 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1758 microversion: 2.1 time: 0.164819 Jun 27 18:54:34.682717 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 496/971] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:34 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:35.700105 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-ffe39a4a-cfda-467e-8ec0-07f63394ce04 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:35.700728 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-ffe39a4a-cfda-467e-8ec0-07f63394ce04 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:35.707235 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ffe39a4a-cfda-467e-8ec0-07f63394ce04 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:35.707796 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ffe39a4a-cfda-467e-8ec0-07f63394ce04 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:35.708553 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ffe39a4a-cfda-467e-8ec0-07f63394ce04 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:35.708990 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ffe39a4a-cfda-467e-8ec0-07f63394ce04 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:35.853779 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-ffe39a4a-cfda-467e-8ec0-07f63394ce04 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:35.861609 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-ffe39a4a-cfda-467e-8ec0-07f63394ce04 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1758 microversion: 2.1 time: 0.165433 Jun 27 18:54:35.862403 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 476/972] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:35 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:36.880570 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-e281ccf5-1b86-4ed4-866a-be2620a5ec0f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:36.881188 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-e281ccf5-1b86-4ed4-866a-be2620a5ec0f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:36.887677 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e281ccf5-1b86-4ed4-866a-be2620a5ec0f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:36.888129 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e281ccf5-1b86-4ed4-866a-be2620a5ec0f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:36.888893 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e281ccf5-1b86-4ed4-866a-be2620a5ec0f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:36.889337 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-e281ccf5-1b86-4ed4-866a-be2620a5ec0f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:37.028895 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-e281ccf5-1b86-4ed4-866a-be2620a5ec0f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:37.037350 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-e281ccf5-1b86-4ed4-866a-be2620a5ec0f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1758 microversion: 2.1 time: 0.161439 Jun 27 18:54:37.037917 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 497/973] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:36 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:38.054331 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-b693f8fe-f0ee-4894-9830-0233cb346d2e tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:38.054914 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-b693f8fe-f0ee-4894-9830-0233cb346d2e tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:38.061354 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b693f8fe-f0ee-4894-9830-0233cb346d2e tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:38.061806 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b693f8fe-f0ee-4894-9830-0233cb346d2e tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:38.062602 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b693f8fe-f0ee-4894-9830-0233cb346d2e tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:38.063044 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b693f8fe-f0ee-4894-9830-0233cb346d2e tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:38.210918 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-b693f8fe-f0ee-4894-9830-0233cb346d2e tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:38.218785 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-b693f8fe-f0ee-4894-9830-0233cb346d2e tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1758 microversion: 2.1 time: 0.168427 Jun 27 18:54:38.219343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 477/974] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:38 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:39.126593 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-5adb6a40-d47f-4fcd-8e78-bdc209868a82 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:39.127155 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-5adb6a40-d47f-4fcd-8e78-bdc209868a82 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:39.133684 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5adb6a40-d47f-4fcd-8e78-bdc209868a82 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:39.134133 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5adb6a40-d47f-4fcd-8e78-bdc209868a82 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:39.134935 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5adb6a40-d47f-4fcd-8e78-bdc209868a82 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:39.135380 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5adb6a40-d47f-4fcd-8e78-bdc209868a82 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:39.158790 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-5adb6a40-d47f-4fcd-8e78-bdc209868a82 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2/ips" status: 200 len: 151 microversion: 2.1 time: 0.036185 Jun 27 18:54:39.159353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 498/975] 10.222.0.15 () {58 vars in 1247 bytes} [Mon Jun 27 18:54:39 2022] GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:54:39.170235 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-05ce5762-3efb-43e8-8a18-78181f22ca6b tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00d09eb9-b0c5-4a26-89ca-2932ccf117aa"}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:54:39.171304 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-05ce5762-3efb-43e8-8a18-78181f22ca6b tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:39.178265 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-05ce5762-3efb-43e8-8a18-78181f22ca6b tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:39.178733 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-05ce5762-3efb-43e8-8a18-78181f22ca6b tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:39.179487 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-05ce5762-3efb-43e8-8a18-78181f22ca6b tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:39.179918 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-05ce5762-3efb-43e8-8a18-78181f22ca6b tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:39.235584 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-d431efc2-b266-4bd1-8c3c-16252842b37a tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:39.236215 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-d431efc2-b266-4bd1-8c3c-16252842b37a tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:39.242531 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d431efc2-b266-4bd1-8c3c-16252842b37a tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:39.242992 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d431efc2-b266-4bd1-8c3c-16252842b37a tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:39.243771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d431efc2-b266-4bd1-8c3c-16252842b37a tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:39.244213 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d431efc2-b266-4bd1-8c3c-16252842b37a tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:39.261379 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-05ce5762-3efb-43e8-8a18-78181f22ca6b tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] HTTP exception thrown: Invalid volume: volume 00d09eb9-b0c5-4a26-89ca-2932ccf117aa is already attached to instances: f070b8e2-2360-4dec-b274-cfa0a90a8a22 Jun 27 18:54:39.263162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-05ce5762-3efb-43e8-8a18-78181f22ca6b tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Request method failure captured: Jun 27 18:54:39.263162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: POST /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2/os-volume_attachments HTTP/1.1 Jun 27 18:54:39.263162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 18:54:39.263162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 18:54:39.263162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 18:54:39.263162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 74 Jun 27 18:54:39.263162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 18:54:39.263162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 18:54:39.263162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 18:54:39.263162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 18:54:39.263162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufxujj71f0JcK6xynWFlkvJylD3VaW76hhLj6aYJdaIU72emt5fWMZbhrMQMXmzSnlN7izfTbQz8DDDms1aAEVEIobTTP_Qgn0UA0fG5dAYGKFUUdOXMjzqUBw4nwaAUQKw-YAQrfZf2wWTIXVqD3NfGLb3EDQz_tkmxCaoeCzMl1tQ Jun 27 18:54:39.263162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 18:54:39.263162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 18:54:39.263162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 18:54:39.263162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 18:54:39.263162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 18:54:39.263162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 18:54:39.263162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:54:39.263162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:54:39.263162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 18:54:39.263162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 18:54:39.264665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:54:39.264665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:54:39.264665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:54:39.264665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:54:39.264665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:54:39.264665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 18:54:39.264665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 18:54:39.264665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: 48ac761d30de4fb49478a78ccf23ab92 Jun 27 18:54:39.264665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:54:39.264665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Jun 27 18:54:39.264665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {"volumeAttachment": {"volumeId": "00d09eb9-b0c5-4a26-89ca-2932ccf117aa"}} Jun 27 18:54:39.264665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: > Jun 27 18:54:39.265557 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Invalid volume: volume 00d09eb9-b0c5-4a26-89ca-2932ccf117aa is already attached to instances: f070b8e2-2360-4dec-b274-cfa0a90a8a22 Jun 27 18:54:39.265557 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'server_id': '0c49e97a-ae62-46cd-addc-ac3558e6feb2', 'body': {'volumeAttachment': {'volumeId': '00d09eb9-b0c5-4a26-89ca-2932ccf117aa'}}} Jun 27 18:54:39.265557 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:54:39.265557 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:54:39.265557 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 27 18:54:39.265557 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 27 18:54:39.265557 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 18:54:39.265557 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 18:54:39.265557 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 27 18:54:39.265557 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 27 18:54:39.265557 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 27 18:54:39.265557 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 27 18:54:39.265557 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 27 18:54:39.265557 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 27 18:54:39.265557 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 00d09eb9-b0c5-4a26-89ca-2932ccf117aa is already attached to instances: f070b8e2-2360-4dec-b274-cfa0a90a8a22 Jun 27 18:54:39.265557 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:54:39.265557 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:54:39.265557 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:54:39.265557 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:54:39.266903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:54:39.266903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:54:39.266903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:54:39.266903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:54:39.266903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:54:39.266903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:54:39.266903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 18:54:39.266903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 18:54:39.266903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 18:54:39.266903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 18:54:39.266903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 18:54:39.266903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 18:54:39.266903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 27 18:54:39.266903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 27 18:54:39.266903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 00d09eb9-b0c5-4a26-89ca-2932ccf117aa is already attached to instances: f070b8e2-2360-4dec-b274-cfa0a90a8a22 Jun 27 18:54:39.266903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:54:39.266903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:54:39.266903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:54:39.266903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:54:39.266903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:54:39.268226 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:54:39.268226 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:54:39.268226 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:54:39.268226 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 00d09eb9-b0c5-4a26-89ca-2932ccf117aa is already attached to instances: f070b8e2-2360-4dec-b274-cfa0a90a8a22 Jun 27 18:54:39.268226 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:54:39.268226 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-05ce5762-3efb-43e8-8a18-78181f22ca6b tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Returning 400 to user: Invalid volume: volume 00d09eb9-b0c5-4a26-89ca-2932ccf117aa is already attached to instances: f070b8e2-2360-4dec-b274-cfa0a90a8a22 {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:54:39.268226 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-05ce5762-3efb-43e8-8a18-78181f22ca6b tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "POST /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098399 Jun 27 18:54:39.268226 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 478/976] 10.222.0.15 () {60 vars in 1322 bytes} [Mon Jun 27 18:54:39 2022] POST /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 27 18:54:39.274270 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-b18d1182-d2b5-4996-a405-f5055f468bea tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:39.274799 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-b18d1182-d2b5-4996-a405-f5055f468bea tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:39.281538 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b18d1182-d2b5-4996-a405-f5055f468bea tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:39.281989 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b18d1182-d2b5-4996-a405-f5055f468bea tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:39.282816 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b18d1182-d2b5-4996-a405-f5055f468bea tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:39.283250 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b18d1182-d2b5-4996-a405-f5055f468bea tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:39.309485 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-b18d1182-d2b5-4996-a405-f5055f468bea tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] Going to try to terminate instance {{(pid=124717) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 18:54:39.393126 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-d431efc2-b266-4bd1-8c3c-16252842b37a tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:39.401165 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-d431efc2-b266-4bd1-8c3c-16252842b37a tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1761 microversion: 2.1 time: 0.169376 Jun 27 18:54:39.401786 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 499/977] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:39 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1761 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:54:39.578016 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-b18d1182-d2b5-4996-a405-f5055f468bea tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2" status: 204 len: 0 microversion: 2.1 time: 0.308232 Jun 27 18:54:39.578646 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 479/978] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:54:39 2022] DELETE /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 18:54:39.586987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-41c1c731-bf97-4dfe-8e46-2f7139967a84 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:39.587654 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-41c1c731-bf97-4dfe-8e46-2f7139967a84 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:39.593727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-41c1c731-bf97-4dfe-8e46-2f7139967a84 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:39.594172 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-41c1c731-bf97-4dfe-8e46-2f7139967a84 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:39.594972 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-41c1c731-bf97-4dfe-8e46-2f7139967a84 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:39.595411 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-41c1c731-bf97-4dfe-8e46-2f7139967a84 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:39.730499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-41c1c731-bf97-4dfe-8e46-2f7139967a84 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:39.738130 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-41c1c731-bf97-4dfe-8e46-2f7139967a84 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2" status: 200 len: 1683 microversion: 2.1 time: 0.155120 Jun 27 18:54:39.738744 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 500/979] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:39 2022] GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:40.757929 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-2446be48-cf95-4f53-9ced-fd591b7f4a47 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:40.758654 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-2446be48-cf95-4f53-9ced-fd591b7f4a47 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:40.765148 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2446be48-cf95-4f53-9ced-fd591b7f4a47 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:40.765592 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2446be48-cf95-4f53-9ced-fd591b7f4a47 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:40.766345 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2446be48-cf95-4f53-9ced-fd591b7f4a47 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:40.766814 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2446be48-cf95-4f53-9ced-fd591b7f4a47 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:40.896108 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-2446be48-cf95-4f53-9ced-fd591b7f4a47 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:40.903479 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-2446be48-cf95-4f53-9ced-fd591b7f4a47 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2" status: 200 len: 1683 microversion: 2.1 time: 0.150315 Jun 27 18:54:40.904030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 480/980] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:40 2022] GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:41.920059 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-c601dcae-dc5c-47d5-af2a-32dd3eb35ed2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:41.920685 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-c601dcae-dc5c-47d5-af2a-32dd3eb35ed2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:41.935598 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c601dcae-dc5c-47d5-af2a-32dd3eb35ed2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:41.942626 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c601dcae-dc5c-47d5-af2a-32dd3eb35ed2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:41.942626 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c601dcae-dc5c-47d5-af2a-32dd3eb35ed2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:41.942626 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c601dcae-dc5c-47d5-af2a-32dd3eb35ed2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:42.023234 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-08cdb429-8762-4ab6-87f3-43a399f25402 req-9d62388b-7ad1-46a0-abff-9513e9c81e98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c49e97a-ae62-46cd-addc-ac3558e6feb2", "name": "network-vif-deleted", "tag": "693ee883-a693-4d53-b73e-4252479626ee"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:54:42.024054 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c601dcae-dc5c-47d5-af2a-32dd3eb35ed2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:42.031931 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-08cdb429-8762-4ab6-87f3-43a399f25402 req-9d62388b-7ad1-46a0-abff-9513e9c81e98 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:42.032373 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-08cdb429-8762-4ab6-87f3-43a399f25402 req-9d62388b-7ad1-46a0-abff-9513e9c81e98 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:42.032669 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-c601dcae-dc5c-47d5-af2a-32dd3eb35ed2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2" status: 200 len: 1615 microversion: 2.1 time: 0.116079 Jun 27 18:54:42.033339 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 501/981] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:41 2022] GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2 => generated 1615 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:42.044490 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-08cdb429-8762-4ab6-87f3-43a399f25402 req-9d62388b-7ad1-46a0-abff-9513e9c81e98 service nova] Creating event network-vif-deleted:693ee883-a693-4d53-b73e-4252479626ee for instance 0c49e97a-ae62-46cd-addc-ac3558e6feb2 on hv-cinder-84460 Jun 27 18:54:42.049625 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-08cdb429-8762-4ab6-87f3-43a399f25402 req-9d62388b-7ad1-46a0-abff-9513e9c81e98 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030757 Jun 27 18:54:42.050219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 481/982] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:54:43.050751 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-cb6215ae-4dfd-4d92-a567-c7e830821f03 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:43.052101 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-cb6215ae-4dfd-4d92-a567-c7e830821f03 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:43.058648 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cb6215ae-4dfd-4d92-a567-c7e830821f03 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:43.061193 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cb6215ae-4dfd-4d92-a567-c7e830821f03 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:43.061193 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cb6215ae-4dfd-4d92-a567-c7e830821f03 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:43.061193 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cb6215ae-4dfd-4d92-a567-c7e830821f03 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:43.074164 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-cb6215ae-4dfd-4d92-a567-c7e830821f03 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] HTTP exception thrown: Instance 0c49e97a-ae62-46cd-addc-ac3558e6feb2 could not be found. Jun 27 18:54:43.075850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-cb6215ae-4dfd-4d92-a567-c7e830821f03 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Request method failure captured: Jun 27 18:54:43.075850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2 HTTP/1.1 Jun 27 18:54:43.075850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:54:43.075850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:54:43.075850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:54:43.075850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:54:43.075850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:54:43.075850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:54:43.075850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:54:43.075850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:54:43.075850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufxujj71f0JcK6xynWFlkvJylD3VaW76hhLj6aYJdaIU72emt5fWMZbhrMQMXmzSnlN7izfTbQz8DDDms1aAEVEIobTTP_Qgn0UA0fG5dAYGKFUUdOXMjzqUBw4nwaAUQKw-YAQrfZf2wWTIXVqD3NfGLb3EDQz_tkmxCaoeCzMl1tQ Jun 27 18:54:43.075850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:54:43.075850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:54:43.075850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:54:43.075850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:54:43.075850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:54:43.075850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:54:43.075850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:54:43.075850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:54:43.075850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:54:43.075850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:54:43.077452 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:54:43.077452 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:54:43.077452 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:54:43.077452 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:54:43.077452 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:54:43.077452 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:54:43.077452 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:54:43.077452 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: 48ac761d30de4fb49478a78ccf23ab92 Jun 27 18:54:43.077452 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:54:43.077452 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: > Jun 27 18:54:43.077452 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Instance 0c49e97a-ae62-46cd-addc-ac3558e6feb2 could not be found. Jun 27 18:54:43.077452 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': '0c49e97a-ae62-46cd-addc-ac3558e6feb2'} Jun 27 18:54:43.078308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:54:43.078308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:54:43.078308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:54:43.078308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:54:43.078308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:54:43.078308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:54:43.078308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:54:43.078308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:54:43.078308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:54:43.078308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:54:43.078308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c49e97a-ae62-46cd-addc-ac3558e6feb2 could not be found. Jun 27 18:54:43.078308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:54:43.078308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:54:43.078308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:54:43.078308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:54:43.078308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:54:43.078308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:54:43.078308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:54:43.078308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:54:43.078308 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:54:43.079987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:54:43.079987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:54:43.079987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:54:43.079987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:54:43.079987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:54:43.079987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:54:43.079987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:54:43.079987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c49e97a-ae62-46cd-addc-ac3558e6feb2 could not be found. Jun 27 18:54:43.079987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:54:43.079987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:54:43.079987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:54:43.079987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:54:43.079987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:54:43.079987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:54:43.079987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:54:43.079987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:54:43.079987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c49e97a-ae62-46cd-addc-ac3558e6feb2 could not be found. Jun 27 18:54:43.079987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:54:43.081649 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-cb6215ae-4dfd-4d92-a567-c7e830821f03 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Returning 404 to user: Instance 0c49e97a-ae62-46cd-addc-ac3558e6feb2 could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:54:43.081649 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-cb6215ae-4dfd-4d92-a567-c7e830821f03 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2" status: 404 len: 111 microversion: 2.1 time: 0.031202 Jun 27 18:54:43.081649 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 502/983] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:43 2022] GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:54:43.087412 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-d7b7bc4c-ff99-4667-8e8e-7a48f33fce8f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '.version_select at 0x7f700feeec10>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:43.166141 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-d7b7bc4c-ff99-4667-8e8e-7a48f33fce8f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-625746239" status: 202 len: 0 microversion: 2.1 time: 0.083459 Jun 27 18:54:43.166864 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 482/984] 10.222.0.15 () {58 vars in 1217 bytes} [Mon Jun 27 18:54:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-625746239 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:54:43.993379 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-fa01e3cc-6ae3-4ebe-b0c2-0970d1c727e9 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:43.993875 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-fa01e3cc-6ae3-4ebe-b0c2-0970d1c727e9 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:44.000262 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fa01e3cc-6ae3-4ebe-b0c2-0970d1c727e9 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:44.000712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fa01e3cc-6ae3-4ebe-b0c2-0970d1c727e9 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:44.001472 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fa01e3cc-6ae3-4ebe-b0c2-0970d1c727e9 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:44.001911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fa01e3cc-6ae3-4ebe-b0c2-0970d1c727e9 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:44.081578 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.objects.instance [None req-fa01e3cc-6ae3-4ebe-b0c2-0970d1c727e9 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lazy-loading 'services' on Instance uuid f070b8e2-2360-4dec-b274-cfa0a90a8a22 {{(pid=124716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:54:44.268990 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-fa01e3cc-6ae3-4ebe-b0c2-0970d1c727e9 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22/os-volume_attachments/00d09eb9-b0c5-4a26-89ca-2932ccf117aa" status: 202 len: 0 microversion: 2.1 time: 0.279550 Jun 27 18:54:44.269608 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 503/985] 10.222.0.15 () {58 vars in 1415 bytes} [Mon Jun 27 18:54:43 2022] DELETE /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22/os-volume_attachments/00d09eb9-b0c5-4a26-89ca-2932ccf117aa => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:54:44.279181 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-43ee84bb-346c-46c1-83b5-b17158aa830e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:44.280370 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-43ee84bb-346c-46c1-83b5-b17158aa830e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:44.287200 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-43ee84bb-346c-46c1-83b5-b17158aa830e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:44.287708 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-43ee84bb-346c-46c1-83b5-b17158aa830e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:44.288446 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-43ee84bb-346c-46c1-83b5-b17158aa830e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:44.288887 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-43ee84bb-346c-46c1-83b5-b17158aa830e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:44.317402 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-43ee84bb-346c-46c1-83b5-b17158aa830e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042307 Jun 27 18:54:44.317957 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 483/986] 10.222.0.15 () {58 vars in 1301 bytes} [Mon Jun 27 18:54:44 2022] GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:54:45.329214 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-743721c3-42c6-4cfe-8f4c-28b457478254 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:45.330301 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-743721c3-42c6-4cfe-8f4c-28b457478254 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:45.337686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-743721c3-42c6-4cfe-8f4c-28b457478254 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:45.338138 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-743721c3-42c6-4cfe-8f4c-28b457478254 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:45.338940 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-743721c3-42c6-4cfe-8f4c-28b457478254 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:45.339382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-743721c3-42c6-4cfe-8f4c-28b457478254 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:45.370095 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-743721c3-42c6-4cfe-8f4c-28b457478254 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045284 Jun 27 18:54:45.370675 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 504/987] 10.222.0.15 () {58 vars in 1301 bytes} [Mon Jun 27 18:54:45 2022] GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 18:54:45.434576 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-bfc56dcb-ba2b-4817-84eb-e920fc6a0485 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:45.435099 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-bfc56dcb-ba2b-4817-84eb-e920fc6a0485 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:45.441103 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bfc56dcb-ba2b-4817-84eb-e920fc6a0485 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:45.441550 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bfc56dcb-ba2b-4817-84eb-e920fc6a0485 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:45.442984 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bfc56dcb-ba2b-4817-84eb-e920fc6a0485 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:45.443423 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-bfc56dcb-ba2b-4817-84eb-e920fc6a0485 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:45.467927 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-bfc56dcb-ba2b-4817-84eb-e920fc6a0485 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Going to try to terminate instance {{(pid=124717) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 18:54:45.600758 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:54:45.783710 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-bfc56dcb-ba2b-4817-84eb-e920fc6a0485 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22" status: 204 len: 0 microversion: 2.1 time: 0.352944 Jun 27 18:54:45.784350 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 484/988] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:54:45 2022] DELETE /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 18:54:45.792399 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-9695071f-74f2-47f4-a0b4-a37a9a1d2616 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:45.799442 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-9695071f-74f2-47f4-a0b4-a37a9a1d2616 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:45.799442 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9695071f-74f2-47f4-a0b4-a37a9a1d2616 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:45.799442 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9695071f-74f2-47f4-a0b4-a37a9a1d2616 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:45.800297 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9695071f-74f2-47f4-a0b4-a37a9a1d2616 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:45.800739 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9695071f-74f2-47f4-a0b4-a37a9a1d2616 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:45.931741 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-9695071f-74f2-47f4-a0b4-a37a9a1d2616 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:45.935295 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:54:45.939724 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-9695071f-74f2-47f4-a0b4-a37a9a1d2616 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22" status: 200 len: 1683 microversion: 2.1 time: 0.151147 Jun 27 18:54:45.946595 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 505/989] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:45 2022] GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:46.958458 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-90ef29b6-f68b-4212-9fca-29285da37c7e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:46.959191 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-90ef29b6-f68b-4212-9fca-29285da37c7e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:46.966157 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-90ef29b6-f68b-4212-9fca-29285da37c7e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:46.966637 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-90ef29b6-f68b-4212-9fca-29285da37c7e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:46.967389 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-90ef29b6-f68b-4212-9fca-29285da37c7e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:46.967820 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-90ef29b6-f68b-4212-9fca-29285da37c7e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:47.099149 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-90ef29b6-f68b-4212-9fca-29285da37c7e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:47.106603 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-90ef29b6-f68b-4212-9fca-29285da37c7e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22" status: 200 len: 1683 microversion: 2.1 time: 0.152353 Jun 27 18:54:47.107169 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 485/990] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:46 2022] GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:48.137202 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-12988100-eb42-4b02-85d1-05b398bb0dff tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:48.137863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-12988100-eb42-4b02-85d1-05b398bb0dff tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:48.142538 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-b0918bb9-0178-4e6f-83f2-538f675f065f req-80175f13-0ced-4ff3-9199-0ee2c21df40d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f070b8e2-2360-4dec-b274-cfa0a90a8a22", "name": "network-vif-deleted", "tag": "7aba1775-3560-484b-ab57-2929895ae181"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:54:48.145004 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-12988100-eb42-4b02-85d1-05b398bb0dff tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:48.145460 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-12988100-eb42-4b02-85d1-05b398bb0dff tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:48.146228 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-12988100-eb42-4b02-85d1-05b398bb0dff tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:48.146692 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-12988100-eb42-4b02-85d1-05b398bb0dff tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:48.161432 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-b0918bb9-0178-4e6f-83f2-538f675f065f req-80175f13-0ced-4ff3-9199-0ee2c21df40d service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:48.162109 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-b0918bb9-0178-4e6f-83f2-538f675f065f req-80175f13-0ced-4ff3-9199-0ee2c21df40d service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:48.175918 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-b0918bb9-0178-4e6f-83f2-538f675f065f req-80175f13-0ced-4ff3-9199-0ee2c21df40d service nova] Creating event network-vif-deleted:7aba1775-3560-484b-ab57-2929895ae181 for instance f070b8e2-2360-4dec-b274-cfa0a90a8a22 on hv-cinder-84460 Jun 27 18:54:48.182094 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-b0918bb9-0178-4e6f-83f2-538f675f065f req-80175f13-0ced-4ff3-9199-0ee2c21df40d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057737 Jun 27 18:54:48.182985 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 486/991] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:54:48.216743 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-12988100-eb42-4b02-85d1-05b398bb0dff tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:48.225641 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-12988100-eb42-4b02-85d1-05b398bb0dff tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22" status: 200 len: 1615 microversion: 2.1 time: 0.103577 Jun 27 18:54:48.226929 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 506/992] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:48 2022] GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22 => generated 1615 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:49.244303 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-20a14b8e-61ed-466a-b04d-a307795bb587 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:49.245020 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-20a14b8e-61ed-466a-b04d-a307795bb587 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:49.251405 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-20a14b8e-61ed-466a-b04d-a307795bb587 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:49.251853 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-20a14b8e-61ed-466a-b04d-a307795bb587 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:49.252616 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-20a14b8e-61ed-466a-b04d-a307795bb587 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:49.253053 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-20a14b8e-61ed-466a-b04d-a307795bb587 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:49.265972 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-20a14b8e-61ed-466a-b04d-a307795bb587 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] HTTP exception thrown: Instance f070b8e2-2360-4dec-b274-cfa0a90a8a22 could not be found. Jun 27 18:54:49.267604 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-20a14b8e-61ed-466a-b04d-a307795bb587 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Request method failure captured: Jun 27 18:54:49.267604 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22 HTTP/1.1 Jun 27 18:54:49.267604 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 18:54:49.267604 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 18:54:49.267604 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 18:54:49.267604 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 0 Jun 27 18:54:49.267604 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 18:54:49.267604 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 18:54:49.267604 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 18:54:49.267604 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 18:54:49.267604 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufxujj71f0JcK6xynWFlkvJylD3VaW76hhLj6aYJdaIU72emt5fWMZbhrMQMXmzSnlN7izfTbQz8DDDms1aAEVEIobTTP_Qgn0UA0fG5dAYGKFUUdOXMjzqUBw4nwaAUQKw-YAQrfZf2wWTIXVqD3NfGLb3EDQz_tkmxCaoeCzMl1tQ Jun 27 18:54:49.267604 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 18:54:49.267604 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 18:54:49.267604 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 18:54:49.267604 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 18:54:49.267604 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 18:54:49.267604 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 18:54:49.267604 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:54:49.267604 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:54:49.267604 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 18:54:49.267604 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 18:54:49.268973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:54:49.268973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:54:49.268973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:54:49.268973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:54:49.268973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:54:49.268973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 18:54:49.268973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 18:54:49.268973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: 48ac761d30de4fb49478a78ccf23ab92 Jun 27 18:54:49.268973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:54:49.268973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: > Jun 27 18:54:49.268973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Instance f070b8e2-2360-4dec-b274-cfa0a90a8a22 could not be found. Jun 27 18:54:49.268973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'id': 'f070b8e2-2360-4dec-b274-cfa0a90a8a22'} Jun 27 18:54:49.269827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:54:49.269827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:54:49.269827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:54:49.269827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:54:49.269827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:54:49.269827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:54:49.269827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:54:49.269827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:54:49.269827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:54:49.269827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:54:49.269827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f070b8e2-2360-4dec-b274-cfa0a90a8a22 could not be found. Jun 27 18:54:49.269827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:54:49.269827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:54:49.269827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:54:49.269827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:54:49.269827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:54:49.269827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:54:49.269827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:54:49.269827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:54:49.269827 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:54:49.271369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:54:49.271369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:54:49.271369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:54:49.271369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:54:49.271369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:54:49.271369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:54:49.271369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:54:49.271369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f070b8e2-2360-4dec-b274-cfa0a90a8a22 could not be found. Jun 27 18:54:49.271369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:54:49.271369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:54:49.271369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:54:49.271369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:54:49.271369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:54:49.271369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:54:49.271369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:54:49.271369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:54:49.271369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f070b8e2-2360-4dec-b274-cfa0a90a8a22 could not be found. Jun 27 18:54:49.271369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:54:49.273516 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-20a14b8e-61ed-466a-b04d-a307795bb587 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Returning 404 to user: Instance f070b8e2-2360-4dec-b274-cfa0a90a8a22 could not be found. {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:54:49.273516 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-20a14b8e-61ed-466a-b04d-a307795bb587 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22" status: 404 len: 111 microversion: 2.1 time: 0.029437 Jun 27 18:54:49.273516 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 487/993] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:49 2022] GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:54:49.278983 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-04b19e30-ddea-41e4-aa8f-0193ac117913 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '.version_select at 0x7f700f5c5ee0>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:49.282149 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR oslo.messaging._drivers.impl_rabbit [None req-04b19e30-ddea-41e4-aa8f-0193ac117913 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [f4836ad4-7233-4afd-8c01-d78b169bec76] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 27 18:54:50.289863 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO oslo.messaging._drivers.impl_rabbit [None req-04b19e30-ddea-41e4-aa8f-0193ac117913 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [f4836ad4-7233-4afd-8c01-d78b169bec76] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 34816. Jun 27 18:54:50.382112 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-04b19e30-ddea-41e4-aa8f-0193ac117913 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-423695440" status: 202 len: 0 microversion: 2.1 time: 1.107372 Jun 27 18:54:50.382786 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 507/994] 10.222.0.15 () {58 vars in 1217 bytes} [Mon Jun 27 18:54:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-423695440 => generated 0 bytes in 1109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:54:51.138529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-96bdc9b4-8b93-461b-a098-48ae6aab01c1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Action: 'create', calling method: .version_select at 0x7f700fe5c790>, body: {"keypair": {"name": "tempest-keypair-1328140047", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETpAGc7xZeKJ/L9DJAyoPsPfxHeHphgkL/giH0qp6AwcMeyu4HGwk4oCm7UIE7xnPDvL0fw1hcZXvNaEaHjOJV2cDBWcox1+PfWOWV0dLBr6J4qo0oCMgKOg1p3m1/Nxg=="}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:54:51.153823 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-96bdc9b4-8b93-461b-a098-48ae6aab01c1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Getting quotas for project a981ae734b1e4993bb440918b1a74fe7. Resources: {'key_pairs'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:54:51.157583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-96bdc9b4-8b93-461b-a098-48ae6aab01c1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Getting quotas for user 48ac761d30de4fb49478a78ccf23ab92 and project a981ae734b1e4993bb440918b1a74fe7. Resources: {'key_pairs'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:54:51.239892 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-96bdc9b4-8b93-461b-a098-48ae6aab01c1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.105251 Jun 27 18:54:51.240514 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 488/995] 10.222.0.15 () {60 vars in 1158 bytes} [Mon Jun 27 18:54:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:54:53.694480 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-3f9cb349-3446-4fe5-9bb2-8fb55a375d0d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1324113930", "imageRef": "c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "580ec2de-be59-4921-adbe-91c7f9d3a376"}], "security_groups": [{"name": "tempest-securitygroup--1173320352"}], "key_name": "tempest-keypair-1328140047", "user_data": "}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:54:53.701598 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:54:53.796340 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.network.neutron [None req-3f9cb349-3446-4fe5-9bb2-8fb55a375d0d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] validate_networks() for [('580ec2de-be59-4921-adbe-91c7f9d3a376', None, None, None, None, None)] {{(pid=124716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 18:54:54.155817 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-3f9cb349-3446-4fe5-9bb2-8fb55a375d0d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Flavor limits 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 18:54:54.156248 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-3f9cb349-3446-4fe5-9bb2-8fb55a375d0d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Image limits 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 18:54:54.156724 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-3f9cb349-3446-4fe5-9bb2-8fb55a375d0d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Flavor pref 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 18:54:54.157166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-3f9cb349-3446-4fe5-9bb2-8fb55a375d0d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Image pref 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 18:54:54.157582 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-3f9cb349-3446-4fe5-9bb2-8fb55a375d0d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 18:54:54.166295 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3f9cb349-3446-4fe5-9bb2-8fb55a375d0d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:54.166794 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3f9cb349-3446-4fe5-9bb2-8fb55a375d0d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:54.167596 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3f9cb349-3446-4fe5-9bb2-8fb55a375d0d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:54.168033 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3f9cb349-3446-4fe5-9bb2-8fb55a375d0d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:54.184858 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-3f9cb349-3446-4fe5-9bb2-8fb55a375d0d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Getting quotas for project a981ae734b1e4993bb440918b1a74fe7. Resources: {'ram', 'cores', 'instances'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:54:54.188780 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-3f9cb349-3446-4fe5-9bb2-8fb55a375d0d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Getting quotas for user 48ac761d30de4fb49478a78ccf23ab92 and project a981ae734b1e4993bb440918b1a74fe7. Resources: {'ram', 'cores', 'instances'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:54:54.200230 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-3f9cb349-3446-4fe5-9bb2-8fb55a375d0d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Going to run 1 instances... {{(pid=124716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 18:54:54.202514 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-3f9cb349-3446-4fe5-9bb2-8fb55a375d0d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 18:54:54.339458 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-3f9cb349-3446-4fe5-9bb2-8fb55a375d0d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.649959 Jun 27 18:54:54.340103 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 508/996] 10.222.0.15 () {60 vars in 1146 bytes} [Mon Jun 27 18:54:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 18:54:54.350739 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-7c665233-904d-4ec7-b679-37581ae0cc9e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:54.352717 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-7c665233-904d-4ec7-b679-37581ae0cc9e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:54.354371 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:54:54.407249 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-7c665233-904d-4ec7-b679-37581ae0cc9e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:54.414004 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-7c665233-904d-4ec7-b679-37581ae0cc9e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5" status: 200 len: 1242 microversion: 2.1 time: 0.067741 Jun 27 18:54:54.414603 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 489/997] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:54 2022] GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:55.432270 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-cc9a02aa-8ce2-4f8f-8e36-d829ef83ba95 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:55.432962 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-cc9a02aa-8ce2-4f8f-8e36-d829ef83ba95 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:55.440110 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cc9a02aa-8ce2-4f8f-8e36-d829ef83ba95 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:55.440498 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cc9a02aa-8ce2-4f8f-8e36-d829ef83ba95 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:55.441265 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cc9a02aa-8ce2-4f8f-8e36-d829ef83ba95 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:55.441705 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cc9a02aa-8ce2-4f8f-8e36-d829ef83ba95 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:55.503311 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-cc9a02aa-8ce2-4f8f-8e36-d829ef83ba95 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:55.513902 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-cc9a02aa-8ce2-4f8f-8e36-d829ef83ba95 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5" status: 200 len: 1246 microversion: 2.1 time: 0.083872 Jun 27 18:54:55.513902 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 509/998] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:55 2022] GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:56.529741 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-7b7976d3-5df7-4513-ab6c-c026b963fbb2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:56.530320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-7b7976d3-5df7-4513-ab6c-c026b963fbb2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:56.536508 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7b7976d3-5df7-4513-ab6c-c026b963fbb2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:56.536956 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7b7976d3-5df7-4513-ab6c-c026b963fbb2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:56.537721 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7b7976d3-5df7-4513-ab6c-c026b963fbb2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:56.538158 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7b7976d3-5df7-4513-ab6c-c026b963fbb2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:56.609700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-7b7976d3-5df7-4513-ab6c-c026b963fbb2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:56.617314 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-7b7976d3-5df7-4513-ab6c-c026b963fbb2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5" status: 200 len: 1312 microversion: 2.1 time: 0.092934 Jun 27 18:54:56.617903 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 490/999] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:56 2022] GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:54:57.637132 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-75c0eab8-a1c1-478b-8be2-cdc1acf3d4a1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:57.637753 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-75c0eab8-a1c1-478b-8be2-cdc1acf3d4a1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:57.644584 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-75c0eab8-a1c1-478b-8be2-cdc1acf3d4a1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:57.645039 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-75c0eab8-a1c1-478b-8be2-cdc1acf3d4a1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:57.645819 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-75c0eab8-a1c1-478b-8be2-cdc1acf3d4a1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:57.646265 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-75c0eab8-a1c1-478b-8be2-cdc1acf3d4a1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:57.912263 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-75c0eab8-a1c1-478b-8be2-cdc1acf3d4a1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:57.920212 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-75c0eab8-a1c1-478b-8be2-cdc1acf3d4a1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5" status: 200 len: 1368 microversion: 2.1 time: 0.287587 Jun 27 18:54:57.920790 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 510/1000] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:57 2022] GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 => generated 1368 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:54:58.131022 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-ae82da9b-a92e-4cf7-8072-2c497e05ee52 req-29aad519-0852-4c48-be3e-a27481385e70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5", "tag": "9fc5cc89-09ba-40af-b959-14a896bd1805"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:54:58.147958 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-ae82da9b-a92e-4cf7-8072-2c497e05ee52 req-29aad519-0852-4c48-be3e-a27481385e70 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:58.148230 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-ae82da9b-a92e-4cf7-8072-2c497e05ee52 req-29aad519-0852-4c48-be3e-a27481385e70 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:58.162159 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-ae82da9b-a92e-4cf7-8072-2c497e05ee52 req-29aad519-0852-4c48-be3e-a27481385e70 service nova] Creating event network-changed:9fc5cc89-09ba-40af-b959-14a896bd1805 for instance d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 on hv-cinder-84460 Jun 27 18:54:58.167200 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-ae82da9b-a92e-4cf7-8072-2c497e05ee52 req-29aad519-0852-4c48-be3e-a27481385e70 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043568 Jun 27 18:54:58.169141 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 491/1001] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:54:58.941409 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-1c47c22f-9da5-4ef9-9a00-c75f780f5e59 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:54:58.941952 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-1c47c22f-9da5-4ef9-9a00-c75f780f5e59 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:54:58.948816 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1c47c22f-9da5-4ef9-9a00-c75f780f5e59 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:58.952276 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1c47c22f-9da5-4ef9-9a00-c75f780f5e59 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:58.952276 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1c47c22f-9da5-4ef9-9a00-c75f780f5e59 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:54:58.952276 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1c47c22f-9da5-4ef9-9a00-c75f780f5e59 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:54:59.083280 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-1c47c22f-9da5-4ef9-9a00-c75f780f5e59 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:54:59.091388 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-1c47c22f-9da5-4ef9-9a00-c75f780f5e59 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5" status: 200 len: 1368 microversion: 2.1 time: 0.154014 Jun 27 18:54:59.091961 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 511/1002] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:54:58 2022] GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:55:00.110423 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-63fdf16f-8cef-4849-ab29-8b6a20c0c377 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:00.111126 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-63fdf16f-8cef-4849-ab29-8b6a20c0c377 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:00.117335 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-63fdf16f-8cef-4849-ab29-8b6a20c0c377 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:00.117781 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-63fdf16f-8cef-4849-ab29-8b6a20c0c377 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:00.119291 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-63fdf16f-8cef-4849-ab29-8b6a20c0c377 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:00.119764 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-63fdf16f-8cef-4849-ab29-8b6a20c0c377 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:00.247035 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-63fdf16f-8cef-4849-ab29-8b6a20c0c377 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:55:00.254556 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-63fdf16f-8cef-4849-ab29-8b6a20c0c377 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5" status: 200 len: 1368 microversion: 2.1 time: 0.149383 Jun 27 18:55:00.255106 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 492/1003] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:55:00 2022] GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:55:01.271089 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-bad2e20b-73cb-4bef-84a2-8d257f7b21e8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:01.271706 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-bad2e20b-73cb-4bef-84a2-8d257f7b21e8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:01.278079 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bad2e20b-73cb-4bef-84a2-8d257f7b21e8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:01.278565 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bad2e20b-73cb-4bef-84a2-8d257f7b21e8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:01.279327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bad2e20b-73cb-4bef-84a2-8d257f7b21e8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:01.279765 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bad2e20b-73cb-4bef-84a2-8d257f7b21e8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:01.416688 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-bad2e20b-73cb-4bef-84a2-8d257f7b21e8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:55:01.424367 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-bad2e20b-73cb-4bef-84a2-8d257f7b21e8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5" status: 200 len: 1368 microversion: 2.1 time: 0.157267 Jun 27 18:55:01.426472 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 512/1004] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:55:01 2022] GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:55:02.442293 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-ad1c8feb-dbcb-4177-9b93-68e27e83ef3c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:02.442999 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-ad1c8feb-dbcb-4177-9b93-68e27e83ef3c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:02.449972 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ad1c8feb-dbcb-4177-9b93-68e27e83ef3c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:02.453722 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ad1c8feb-dbcb-4177-9b93-68e27e83ef3c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:02.453722 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ad1c8feb-dbcb-4177-9b93-68e27e83ef3c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:02.453722 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ad1c8feb-dbcb-4177-9b93-68e27e83ef3c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:02.581529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-ad1c8feb-dbcb-4177-9b93-68e27e83ef3c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:55:02.589354 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-ad1c8feb-dbcb-4177-9b93-68e27e83ef3c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5" status: 200 len: 1368 microversion: 2.1 time: 0.151011 Jun 27 18:55:02.589913 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 493/1005] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:55:02 2022] GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:55:03.515110 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-ebcb8979-1eb7-48d6-b973-0fc72df080fc req-7da35d20-7a44-4f83-8fd3-4e6066cd6df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5", "name": "network-vif-plugged", "status": "completed", "tag": "9fc5cc89-09ba-40af-b959-14a896bd1805"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:55:03.523664 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-ebcb8979-1eb7-48d6-b973-0fc72df080fc req-7da35d20-7a44-4f83-8fd3-4e6066cd6df5 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:03.524115 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-ebcb8979-1eb7-48d6-b973-0fc72df080fc req-7da35d20-7a44-4f83-8fd3-4e6066cd6df5 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:03.535751 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-ebcb8979-1eb7-48d6-b973-0fc72df080fc req-7da35d20-7a44-4f83-8fd3-4e6066cd6df5 service nova] Creating event network-vif-plugged:9fc5cc89-09ba-40af-b959-14a896bd1805 for instance d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 on hv-cinder-84460 Jun 27 18:55:03.541336 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-ebcb8979-1eb7-48d6-b973-0fc72df080fc req-7da35d20-7a44-4f83-8fd3-4e6066cd6df5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029978 Jun 27 18:55:03.541922 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 513/1006] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:55:03.605633 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-827bb6d3-d9ea-4e8f-8aac-ec36651a4fd1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:03.606371 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-827bb6d3-d9ea-4e8f-8aac-ec36651a4fd1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:03.612951 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-827bb6d3-d9ea-4e8f-8aac-ec36651a4fd1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:03.613401 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-827bb6d3-d9ea-4e8f-8aac-ec36651a4fd1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:03.614168 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-827bb6d3-d9ea-4e8f-8aac-ec36651a4fd1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:03.614632 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-827bb6d3-d9ea-4e8f-8aac-ec36651a4fd1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:03.747547 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-827bb6d3-d9ea-4e8f-8aac-ec36651a4fd1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:55:03.755163 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-827bb6d3-d9ea-4e8f-8aac-ec36651a4fd1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5" status: 200 len: 1368 microversion: 2.1 time: 0.153992 Jun 27 18:55:03.755733 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 494/1007] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:55:03 2022] GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:55:04.770008 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=2 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:55:04.770801 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=6 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:55:04.775854 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-3f54867e-7af5-4788-8b57-53b255237782 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:04.778815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-3f54867e-7af5-4788-8b57-53b255237782 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:04.782657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3f54867e-7af5-4788-8b57-53b255237782 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:04.783123 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3f54867e-7af5-4788-8b57-53b255237782 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:04.783886 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3f54867e-7af5-4788-8b57-53b255237782 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:04.784327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3f54867e-7af5-4788-8b57-53b255237782 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:05.072636 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3f54867e-7af5-4788-8b57-53b255237782 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:55:05.080111 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-3f54867e-7af5-4788-8b57-53b255237782 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5" status: 200 len: 1368 microversion: 2.1 time: 0.311032 Jun 27 18:55:05.080670 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 514/1008] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:55:04 2022] GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 => generated 1368 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:55:06.097381 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-9ef2acfb-d302-4c8f-9285-c29c7cdae6da tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:06.098230 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-9ef2acfb-d302-4c8f-9285-c29c7cdae6da tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:06.100014 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell0:SELECT=6 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:55:06.105932 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9ef2acfb-d302-4c8f-9285-c29c7cdae6da tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:06.109558 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9ef2acfb-d302-4c8f-9285-c29c7cdae6da tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:06.109558 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9ef2acfb-d302-4c8f-9285-c29c7cdae6da tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:06.109558 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-9ef2acfb-d302-4c8f-9285-c29c7cdae6da tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:06.288502 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-9ef2acfb-d302-4c8f-9285-c29c7cdae6da tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:55:06.296068 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-9ef2acfb-d302-4c8f-9285-c29c7cdae6da tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5" status: 200 len: 1558 microversion: 2.1 time: 0.202511 Jun 27 18:55:06.296632 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 495/1009] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:55:06 2022] GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 => generated 1558 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:55:06.312829 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-5c391700-7863-450d-9c9d-5858460f37e4 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:06.313346 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-5c391700-7863-450d-9c9d-5858460f37e4 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:06.319710 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5c391700-7863-450d-9c9d-5858460f37e4 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:06.321243 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5c391700-7863-450d-9c9d-5858460f37e4 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:06.321243 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5c391700-7863-450d-9c9d-5858460f37e4 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:06.322022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-5c391700-7863-450d-9c9d-5858460f37e4 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:06.406170 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-5c391700-7863-450d-9c9d-5858460f37e4 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097146 Jun 27 18:55:06.406794 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 515/1010] 10.222.0.15 () {58 vars in 1274 bytes} [Mon Jun 27 18:55:06 2022] GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:55:07.631857 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-cd0a95e1-248c-40b7-bb01-b73bc0d1c1d8 req-aabb2038-3800-487d-a682-86017c566880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5", "tag": "9fc5cc89-09ba-40af-b959-14a896bd1805"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:55:07.640675 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-cd0a95e1-248c-40b7-bb01-b73bc0d1c1d8 req-aabb2038-3800-487d-a682-86017c566880 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:07.641126 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-cd0a95e1-248c-40b7-bb01-b73bc0d1c1d8 req-aabb2038-3800-487d-a682-86017c566880 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:07.652922 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-cd0a95e1-248c-40b7-bb01-b73bc0d1c1d8 req-aabb2038-3800-487d-a682-86017c566880 service nova] Creating event network-changed:9fc5cc89-09ba-40af-b959-14a896bd1805 for instance d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 on hv-cinder-84460 Jun 27 18:55:07.657856 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-cd0a95e1-248c-40b7-bb01-b73bc0d1c1d8 req-aabb2038-3800-487d-a682-86017c566880 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029747 Jun 27 18:55:07.658675 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 496/1011] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:55:12.567600 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7c48c874-ec4e-406c-bdd0-1a45b8da161f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1984299551"}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:55:12.568168 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-7c48c874-ec4e-406c-bdd0-1a45b8da161f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:12.574767 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7c48c874-ec4e-406c-bdd0-1a45b8da161f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:12.575272 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7c48c874-ec4e-406c-bdd0-1a45b8da161f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:12.575974 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7c48c874-ec4e-406c-bdd0-1a45b8da161f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:12.576440 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7c48c874-ec4e-406c-bdd0-1a45b8da161f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:12.702470 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.network.security_group_api [None req-7c48c874-ec4e-406c-bdd0-1a45b8da161f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Removing security group 916371a6-db3f-4e97-84b5-74d2f9430d85 from port c5c8f530-dd25-40c8-8902-f00d606c2ccc Jun 27 18:55:13.122245 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-7c48c874-ec4e-406c-bdd0-1a45b8da161f tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "POST /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d/action" status: 202 len: 0 microversion: 2.1 time: 0.559110 Jun 27 18:55:13.132124 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 516/1012] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Jun 27 18:55:12 2022] POST /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d/action => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:55:13.136480 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-46ed47ec-a328-4a1e-ab39-006c42321006 req-3af6408a-357b-409e-83c5-3519c4d30541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eefc02a7-6c4c-4eb1-9168-c5182c68714d", "tag": "c5c8f530-dd25-40c8-8902-f00d606c2ccc"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:55:13.162729 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-46ed47ec-a328-4a1e-ab39-006c42321006 req-3af6408a-357b-409e-83c5-3519c4d30541 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:13.163757 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-46ed47ec-a328-4a1e-ab39-006c42321006 req-3af6408a-357b-409e-83c5-3519c4d30541 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:13.185851 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-46ed47ec-a328-4a1e-ab39-006c42321006 req-3af6408a-357b-409e-83c5-3519c4d30541 service nova] Creating event network-changed:c5c8f530-dd25-40c8-8902-f00d606c2ccc for instance eefc02a7-6c4c-4eb1-9168-c5182c68714d on hv-cinder-84460 Jun 27 18:55:13.194463 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-46ed47ec-a328-4a1e-ab39-006c42321006 req-3af6408a-357b-409e-83c5-3519c4d30541 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064255 Jun 27 18:55:13.197099 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 497/1013] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:55:14.604430 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7d5a6ead-b5d1-4f1d-acc7-f3f480ab712d tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:14.605017 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-7d5a6ead-b5d1-4f1d-acc7-f3f480ab712d tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:14.611390 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7d5a6ead-b5d1-4f1d-acc7-f3f480ab712d tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:14.611828 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7d5a6ead-b5d1-4f1d-acc7-f3f480ab712d tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:14.612599 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7d5a6ead-b5d1-4f1d-acc7-f3f480ab712d tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:14.613046 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7d5a6ead-b5d1-4f1d-acc7-f3f480ab712d tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:14.693415 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.objects.instance [None req-7d5a6ead-b5d1-4f1d-acc7-f3f480ab712d tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lazy-loading 'services' on Instance uuid eefc02a7-6c4c-4eb1-9168-c5182c68714d {{(pid=124716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:55:14.904312 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-7d5a6ead-b5d1-4f1d-acc7-f3f480ab712d tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "DELETE /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d/os-volume_attachments/d99b9b29-4f4c-469d-8941-7456d796d4a2" status: 202 len: 0 microversion: 2.1 time: 0.304931 Jun 27 18:55:14.907576 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 517/1014] 10.222.0.15 () {58 vars in 1415 bytes} [Mon Jun 27 18:55:14 2022] DELETE /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d/os-volume_attachments/d99b9b29-4f4c-469d-8941-7456d796d4a2 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:55:14.914491 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-b35a414b-38bc-42f9-b5c4-357a8b183e85 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:14.915678 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-b35a414b-38bc-42f9-b5c4-357a8b183e85 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:14.922485 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b35a414b-38bc-42f9-b5c4-357a8b183e85 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:14.922976 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b35a414b-38bc-42f9-b5c4-357a8b183e85 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:14.923723 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b35a414b-38bc-42f9-b5c4-357a8b183e85 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:14.924170 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b35a414b-38bc-42f9-b5c4-357a8b183e85 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:14.953443 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-b35a414b-38bc-42f9-b5c4-357a8b183e85 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043825 Jun 27 18:55:14.954015 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 498/1015] 10.222.0.15 () {58 vars in 1301 bytes} [Mon Jun 27 18:55:14 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:55:15.214458 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-979eb84a-a682-4912-ac62-6a065cc0116a req-7c3e5522-a5eb-4c09-9667-ce992cba0cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eefc02a7-6c4c-4eb1-9168-c5182c68714d", "tag": "c5c8f530-dd25-40c8-8902-f00d606c2ccc"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:55:15.223066 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-979eb84a-a682-4912-ac62-6a065cc0116a req-7c3e5522-a5eb-4c09-9667-ce992cba0cb3 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:15.223449 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-979eb84a-a682-4912-ac62-6a065cc0116a req-7c3e5522-a5eb-4c09-9667-ce992cba0cb3 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:15.234675 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-979eb84a-a682-4912-ac62-6a065cc0116a req-7c3e5522-a5eb-4c09-9667-ce992cba0cb3 service nova] Creating event network-changed:c5c8f530-dd25-40c8-8902-f00d606c2ccc for instance eefc02a7-6c4c-4eb1-9168-c5182c68714d on hv-cinder-84460 Jun 27 18:55:15.239661 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-979eb84a-a682-4912-ac62-6a065cc0116a req-7c3e5522-a5eb-4c09-9667-ce992cba0cb3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029452 Jun 27 18:55:15.240268 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 518/1016] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:55:15.966290 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-b7f29cbd-0756-42ef-b9dd-8a72ad9545ac tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:15.967273 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-b7f29cbd-0756-42ef-b9dd-8a72ad9545ac tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:15.973092 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b7f29cbd-0756-42ef-b9dd-8a72ad9545ac tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:15.973541 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b7f29cbd-0756-42ef-b9dd-8a72ad9545ac tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:15.974302 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b7f29cbd-0756-42ef-b9dd-8a72ad9545ac tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:15.974773 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b7f29cbd-0756-42ef-b9dd-8a72ad9545ac tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:15.979004 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=53 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:55:16.005020 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-b7f29cbd-0756-42ef-b9dd-8a72ad9545ac tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043203 Jun 27 18:55:16.005505 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 499/1017] 10.222.0.15 () {58 vars in 1301 bytes} [Mon Jun 27 18:55:15 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 18:55:16.016442 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-54a24740-93b0-4055-8a5a-e318e2237d52 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:16.017017 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-54a24740-93b0-4055-8a5a-e318e2237d52 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:16.023305 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-54a24740-93b0-4055-8a5a-e318e2237d52 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:16.023749 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-54a24740-93b0-4055-8a5a-e318e2237d52 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:16.025600 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-54a24740-93b0-4055-8a5a-e318e2237d52 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:16.026040 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-54a24740-93b0-4055-8a5a-e318e2237d52 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:16.102067 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-54a24740-93b0-4055-8a5a-e318e2237d52 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] HTTP exception thrown: Instance eefc02a7-6c4c-4eb1-9168-c5182c68714d is not attached to volume d99b9b29-4f4c-469d-8941-7456d796d4a2 Jun 27 18:55:16.105166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-54a24740-93b0-4055-8a5a-e318e2237d52 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Request method failure captured: Jun 27 18:55:16.105166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: DELETE /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d/os-volume_attachments/d99b9b29-4f4c-469d-8941-7456d796d4a2 HTTP/1.1 Jun 27 18:55:16.105166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:55:16.105166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:55:16.105166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:55:16.105166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:55:16.105166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:55:16.105166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:55:16.105166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:55:16.105166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:55:16.105166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufyIygvzb8c8EhCtZqkaG4DDRcbXYMASFYzkDkoevna6j5gzaOgLGA4rvK5L-j92T-9z7DVL0YkYwHMbM_9tcBE-BV0nkcggmA3pCdeAR7oPTQGZm9awMbzuzXmUF0dRSDQUf6YqVtEBZMAqVbvfJTSPeHNqkdrHw57RJS_DRnBFzpY Jun 27 18:55:16.105166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:55:16.105166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:55:16.105166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:55:16.105166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:55:16.105166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:55:16.105166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:55:16.105166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: 22ff7f833172448fa47fbb796cd91c3d Jun 27 18:55:16.105166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-TestMinimumBasicScenario-625073592 Jun 27 18:55:16.105166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:55:16.105166 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:55:16.106868 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/22ff7f833172448fa47fbb796cd91c3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/22ff7f833172448fa47fbb796cd91c3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_22ff7f833172448fa47fbb796cd91c3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/22ff7f833172448fa47fbb796cd91c3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:55:16.106868 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-TestMinimumBasicScenario-625073592 Jun 27 18:55:16.106868 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: 22ff7f833172448fa47fbb796cd91c3d Jun 27 18:55:16.106868 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-TestMinimumBasicScenario-625073592 Jun 27 18:55:16.106868 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-TestMinimumBasicScenario-625073592-project Jun 27 18:55:16.106868 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:55:16.106868 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:55:16.106868 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: 5d58cb1968f240d693e4c414869ffe44 Jun 27 18:55:16.106868 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-TestMinimumBasicScenario-625073592-project Jun 27 18:55:16.106868 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: > Jun 27 18:55:16.106868 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Instance eefc02a7-6c4c-4eb1-9168-c5182c68714d is not attached to volume d99b9b29-4f4c-469d-8941-7456d796d4a2 Jun 27 18:55:16.107815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'server_id': 'eefc02a7-6c4c-4eb1-9168-c5182c68714d', 'id': 'd99b9b29-4f4c-469d-8941-7456d796d4a2'} Jun 27 18:55:16.107815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:55:16.107815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:55:16.107815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 27 18:55:16.107815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 27 18:55:16.107815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 18:55:16.107815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 18:55:16.107815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 27 18:55:16.107815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 27 18:55:16.107815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d99b9b29-4f4c-469d-8941-7456d796d4a2. Jun 27 18:55:16.107815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:55:16.107815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:55:16.107815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:55:16.107815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:55:16.107815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:55:16.107815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:55:16.107815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:55:16.107815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:55:16.107815 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:55:16.109336 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:55:16.109336 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 27 18:55:16.109336 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 27 18:55:16.109336 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eefc02a7-6c4c-4eb1-9168-c5182c68714d is not attached to volume d99b9b29-4f4c-469d-8941-7456d796d4a2 Jun 27 18:55:16.109336 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:55:16.109336 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:55:16.109336 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:55:16.109336 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:55:16.109336 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:55:16.109336 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:55:16.109336 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:55:16.109336 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:55:16.109336 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eefc02a7-6c4c-4eb1-9168-c5182c68714d is not attached to volume d99b9b29-4f4c-469d-8941-7456d796d4a2 Jun 27 18:55:16.109336 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:55:16.109336 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-54a24740-93b0-4055-8a5a-e318e2237d52 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Returning 404 to user: Instance eefc02a7-6c4c-4eb1-9168-c5182c68714d is not attached to volume d99b9b29-4f4c-469d-8941-7456d796d4a2 {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:55:16.110483 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-54a24740-93b0-4055-8a5a-e318e2237d52 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "DELETE /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d/os-volume_attachments/d99b9b29-4f4c-469d-8941-7456d796d4a2" status: 404 len: 154 microversion: 2.1 time: 0.095161 Jun 27 18:55:16.110483 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 519/1018] 10.222.0.15 () {58 vars in 1415 bytes} [Mon Jun 27 18:55:16 2022] DELETE /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d/os-volume_attachments/d99b9b29-4f4c-469d-8941-7456d796d4a2 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:55:17.414714 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-e7113a61-256d-4cd0-a1ec-f25f03eea8c6 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:17.415824 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e7113a61-256d-4cd0-a1ec-f25f03eea8c6 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:17.422494 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e7113a61-256d-4cd0-a1ec-f25f03eea8c6 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:17.422937 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e7113a61-256d-4cd0-a1ec-f25f03eea8c6 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:17.423718 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e7113a61-256d-4cd0-a1ec-f25f03eea8c6 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:17.424150 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-e7113a61-256d-4cd0-a1ec-f25f03eea8c6 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:17.450066 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-e7113a61-256d-4cd0-a1ec-f25f03eea8c6 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Going to try to terminate instance {{(pid=124717) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 18:55:17.692675 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-e7113a61-256d-4cd0-a1ec-f25f03eea8c6 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "DELETE /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 204 len: 0 microversion: 2.1 time: 0.282205 Jun 27 18:55:17.693272 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 500/1019] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:55:17 2022] DELETE /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 18:55:17.707499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-4b05d01a-ffdc-4c2c-a55c-ba52bd8eedfc tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:17.708814 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-4b05d01a-ffdc-4c2c-a55c-ba52bd8eedfc tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:17.715821 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4b05d01a-ffdc-4c2c-a55c-ba52bd8eedfc tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:17.716268 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4b05d01a-ffdc-4c2c-a55c-ba52bd8eedfc tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:17.717026 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4b05d01a-ffdc-4c2c-a55c-ba52bd8eedfc tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:17.717456 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4b05d01a-ffdc-4c2c-a55c-ba52bd8eedfc tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:17.849829 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-4b05d01a-ffdc-4c2c-a55c-ba52bd8eedfc tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:55:17.857704 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-4b05d01a-ffdc-4c2c-a55c-ba52bd8eedfc tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1555 microversion: 2.1 time: 0.154308 Jun 27 18:55:17.858568 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 520/1020] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:55:17 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:55:18.876454 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-f6ad7932-d7ed-4c7d-8f99-cdc204a1e8a1 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:18.877168 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-f6ad7932-d7ed-4c7d-8f99-cdc204a1e8a1 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:18.884125 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f6ad7932-d7ed-4c7d-8f99-cdc204a1e8a1 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:18.884607 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f6ad7932-d7ed-4c7d-8f99-cdc204a1e8a1 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:18.885370 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f6ad7932-d7ed-4c7d-8f99-cdc204a1e8a1 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:18.885812 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f6ad7932-d7ed-4c7d-8f99-cdc204a1e8a1 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:19.020997 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-f6ad7932-d7ed-4c7d-8f99-cdc204a1e8a1 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:55:19.028636 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-f6ad7932-d7ed-4c7d-8f99-cdc204a1e8a1 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1555 microversion: 2.1 time: 0.156648 Jun 27 18:55:19.034300 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 501/1021] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:55:18 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:55:20.037560 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-90a10e52-1417-472c-ac6e-7b0868193726 req-f45066f5-ee97-44bc-b2f8-f28381c28a2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eefc02a7-6c4c-4eb1-9168-c5182c68714d", "name": "network-vif-deleted", "tag": "c5c8f530-dd25-40c8-8902-f00d606c2ccc"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:55:20.046342 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0c932f60-9c27-4116-9271-1f7a4c90e76a tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:20.047611 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-0c932f60-9c27-4116-9271-1f7a4c90e76a tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:20.052051 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-90a10e52-1417-472c-ac6e-7b0868193726 req-f45066f5-ee97-44bc-b2f8-f28381c28a2f service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:20.052508 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-90a10e52-1417-472c-ac6e-7b0868193726 req-f45066f5-ee97-44bc-b2f8-f28381c28a2f service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:20.054500 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0c932f60-9c27-4116-9271-1f7a4c90e76a tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:20.055201 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0c932f60-9c27-4116-9271-1f7a4c90e76a tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:20.056213 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0c932f60-9c27-4116-9271-1f7a4c90e76a tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:20.056763 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0c932f60-9c27-4116-9271-1f7a4c90e76a tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:20.059868 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=1 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:55:20.067628 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-90a10e52-1417-472c-ac6e-7b0868193726 req-f45066f5-ee97-44bc-b2f8-f28381c28a2f service nova] Creating event network-vif-deleted:c5c8f530-dd25-40c8-8902-f00d606c2ccc for instance eefc02a7-6c4c-4eb1-9168-c5182c68714d on hv-cinder-84460 Jun 27 18:55:20.074335 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-90a10e52-1417-472c-ac6e-7b0868193726 req-f45066f5-ee97-44bc-b2f8-f28381c28a2f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040584 Jun 27 18:55:20.079107 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 521/1022] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:55:20.123703 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-0c932f60-9c27-4116-9271-1f7a4c90e76a tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d58cb1968f240d693e4c414869ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ff7f833172448fa47fbb796cd91c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:55:20.131614 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-0c932f60-9c27-4116-9271-1f7a4c90e76a tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 200 len: 1513 microversion: 2.1 time: 0.089719 Jun 27 18:55:20.132503 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 502/1023] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:55:20 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 1513 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:55:21.152146 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a6de119d-2550-4efe-a167-d6b14eeb8cad tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:21.152834 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a6de119d-2550-4efe-a167-d6b14eeb8cad tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] [instance: eefc02a7-6c4c-4eb1-9168-c5182c68714d] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:21.160041 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a6de119d-2550-4efe-a167-d6b14eeb8cad tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:21.160482 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a6de119d-2550-4efe-a167-d6b14eeb8cad tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:21.161237 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a6de119d-2550-4efe-a167-d6b14eeb8cad tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:21.161666 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a6de119d-2550-4efe-a167-d6b14eeb8cad tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:21.175759 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-a6de119d-2550-4efe-a167-d6b14eeb8cad tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] HTTP exception thrown: Instance eefc02a7-6c4c-4eb1-9168-c5182c68714d could not be found. Jun 27 18:55:21.177382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a6de119d-2550-4efe-a167-d6b14eeb8cad tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Request method failure captured: Jun 27 18:55:21.177382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d HTTP/1.1 Jun 27 18:55:21.177382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:55:21.177382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:55:21.177382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:55:21.177382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:55:21.177382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:55:21.177382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:55:21.177382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:55:21.177382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:55:21.177382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufyIygvzb8c8EhCtZqkaG4DDRcbXYMASFYzkDkoevna6j5gzaOgLGA4rvK5L-j92T-9z7DVL0YkYwHMbM_9tcBE-BV0nkcggmA3pCdeAR7oPTQGZm9awMbzuzXmUF0dRSDQUf6YqVtEBZMAqVbvfJTSPeHNqkdrHw57RJS_DRnBFzpY Jun 27 18:55:21.177382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:55:21.177382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:55:21.177382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:55:21.177382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:55:21.177382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:55:21.177382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:55:21.177382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: 22ff7f833172448fa47fbb796cd91c3d Jun 27 18:55:21.177382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-TestMinimumBasicScenario-625073592 Jun 27 18:55:21.177382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:55:21.177382 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:55:21.178898 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/22ff7f833172448fa47fbb796cd91c3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/22ff7f833172448fa47fbb796cd91c3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_22ff7f833172448fa47fbb796cd91c3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/22ff7f833172448fa47fbb796cd91c3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:55:21.178898 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-TestMinimumBasicScenario-625073592 Jun 27 18:55:21.178898 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: 22ff7f833172448fa47fbb796cd91c3d Jun 27 18:55:21.178898 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-TestMinimumBasicScenario-625073592 Jun 27 18:55:21.178898 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-TestMinimumBasicScenario-625073592-project Jun 27 18:55:21.178898 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:55:21.178898 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:55:21.178898 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: 5d58cb1968f240d693e4c414869ffe44 Jun 27 18:55:21.178898 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-TestMinimumBasicScenario-625073592-project Jun 27 18:55:21.178898 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: > Jun 27 18:55:21.178898 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Instance eefc02a7-6c4c-4eb1-9168-c5182c68714d could not be found. Jun 27 18:55:21.178898 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': 'eefc02a7-6c4c-4eb1-9168-c5182c68714d'} Jun 27 18:55:21.179680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:55:21.179680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:55:21.179680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:55:21.179680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:55:21.179680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:55:21.179680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:55:21.179680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:55:21.179680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:55:21.179680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:55:21.179680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:55:21.179680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eefc02a7-6c4c-4eb1-9168-c5182c68714d could not be found. Jun 27 18:55:21.179680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:55:21.179680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:55:21.179680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:55:21.179680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:55:21.179680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:55:21.179680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:55:21.179680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:55:21.179680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:55:21.179680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:55:21.181259 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:55:21.181259 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:55:21.181259 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:55:21.181259 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:55:21.181259 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:55:21.181259 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:55:21.181259 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:55:21.181259 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eefc02a7-6c4c-4eb1-9168-c5182c68714d could not be found. Jun 27 18:55:21.181259 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:55:21.181259 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:55:21.181259 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:55:21.181259 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:55:21.181259 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:55:21.181259 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:55:21.181259 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:55:21.181259 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:55:21.181259 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eefc02a7-6c4c-4eb1-9168-c5182c68714d could not be found. Jun 27 18:55:21.181259 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:55:21.182912 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a6de119d-2550-4efe-a167-d6b14eeb8cad tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Returning 404 to user: Instance eefc02a7-6c4c-4eb1-9168-c5182c68714d could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:55:21.182912 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a6de119d-2550-4efe-a167-d6b14eeb8cad tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d" status: 404 len: 111 microversion: 2.1 time: 0.032011 Jun 27 18:55:21.182912 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 522/1024] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:55:21 2022] GET /compute/v2.1/servers/eefc02a7-6c4c-4eb1-9168-c5182c68714d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 18:55:21.187480 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-f46e4733-6116-4f6b-8f54-656d172653c5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] Calling method '.version_select at 0x7f700ff514c0>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:21.265117 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-f46e4733-6116-4f6b-8f54-656d172653c5 tempest-TestMinimumBasicScenario-625073592 tempest-TestMinimumBasicScenario-625073592-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1984899894" status: 202 len: 0 microversion: 2.1 time: 0.081508 Jun 27 18:55:21.265691 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 503/1025] 10.222.0.15 () {58 vars in 1271 bytes} [Mon Jun 27 18:55:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1984899894 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:55:43.669353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-b9f0f393-8226-453f-904f-65af9aa69877 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:43.669979 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-b9f0f393-8226-453f-904f-65af9aa69877 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:43.672636 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:55:43.677576 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b9f0f393-8226-453f-904f-65af9aa69877 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:43.678020 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b9f0f393-8226-453f-904f-65af9aa69877 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:43.678803 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b9f0f393-8226-453f-904f-65af9aa69877 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:43.679241 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b9f0f393-8226-453f-904f-65af9aa69877 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:43.702412 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-b9f0f393-8226-453f-904f-65af9aa69877 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5/ips" status: 200 len: 150 microversion: 2.1 time: 0.037645 Jun 27 18:55:43.702967 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 523/1026] 10.222.0.15 () {58 vars in 1247 bytes} [Mon Jun 27 18:55:43 2022] GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:55:45.286753 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:55:45.287509 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:55:45.292124 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-eaa4911c-fa51-4b93-953b-38a504373537 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd570acf-5ec4-4591-9710-308ffb0901f2"}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:55:45.295820 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-eaa4911c-fa51-4b93-953b-38a504373537 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:45.300093 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-eaa4911c-fa51-4b93-953b-38a504373537 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:45.300545 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-eaa4911c-fa51-4b93-953b-38a504373537 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:45.301312 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-eaa4911c-fa51-4b93-953b-38a504373537 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:45.301757 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-eaa4911c-fa51-4b93-953b-38a504373537 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:46.142962 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-eaa4911c-fa51-4b93-953b-38a504373537 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "POST /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.857317 Jun 27 18:55:46.143470 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 504/1027] 10.222.0.15 () {60 vars in 1322 bytes} [Mon Jun 27 18:55:45 2022] POST /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5/os-volume_attachments => generated 194 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:55:53.618258 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-4a33f44f-250d-4c0a-a7c8-c8a8114d3533 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd570acf-5ec4-4591-9710-308ffb0901f2"}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:55:53.619353 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-4a33f44f-250d-4c0a-a7c8-c8a8114d3533 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:53.626836 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4a33f44f-250d-4c0a-a7c8-c8a8114d3533 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:53.627291 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4a33f44f-250d-4c0a-a7c8-c8a8114d3533 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:53.628057 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4a33f44f-250d-4c0a-a7c8-c8a8114d3533 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:53.628495 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-4a33f44f-250d-4c0a-a7c8-c8a8114d3533 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:53.706077 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-4a33f44f-250d-4c0a-a7c8-c8a8114d3533 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] HTTP exception thrown: Invalid volume: volume fd570acf-5ec4-4591-9710-308ffb0901f2 is already attached to instances: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 Jun 27 18:55:53.707841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-4a33f44f-250d-4c0a-a7c8-c8a8114d3533 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Request method failure captured: Jun 27 18:55:53.707841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: POST /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5/os-volume_attachments HTTP/1.1 Jun 27 18:55:53.707841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:55:53.707841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:55:53.707841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:55:53.707841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 74 Jun 27 18:55:53.707841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:55:53.707841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:55:53.707841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:55:53.707841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:55:53.707841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufxujj71f0JcK6xynWFlkvJylD3VaW76hhLj6aYJdaIU72emt5fWMZbhrMQMXmzSnlN7izfTbQz8DDDms1aAEVEIobTTP_Qgn0UA0fG5dAYGKFUUdOXMjzqUBw4nwaAUQKw-YAQrfZf2wWTIXVqD3NfGLb3EDQz_tkmxCaoeCzMl1tQ Jun 27 18:55:53.707841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:55:53.707841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:55:53.707841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:55:53.707841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:55:53.707841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:55:53.707841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:55:53.707841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:55:53.707841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:55:53.707841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:55:53.707841 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:55:53.709543 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:55:53.709543 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:55:53.709543 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:55:53.709543 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:55:53.709543 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:55:53.709543 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:55:53.709543 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:55:53.709543 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: 48ac761d30de4fb49478a78ccf23ab92 Jun 27 18:55:53.709543 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:55:53.709543 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Jun 27 18:55:53.709543 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {"volumeAttachment": {"volumeId": "fd570acf-5ec4-4591-9710-308ffb0901f2"}} Jun 27 18:55:53.709543 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: > Jun 27 18:55:53.710614 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Invalid volume: volume fd570acf-5ec4-4591-9710-308ffb0901f2 is already attached to instances: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 Jun 27 18:55:53.710614 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'server_id': 'd2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5', 'body': {'volumeAttachment': {'volumeId': 'fd570acf-5ec4-4591-9710-308ffb0901f2'}}} Jun 27 18:55:53.710614 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:55:53.710614 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:55:53.710614 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 27 18:55:53.710614 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 27 18:55:53.710614 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 18:55:53.710614 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 18:55:53.710614 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 27 18:55:53.710614 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 27 18:55:53.710614 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 27 18:55:53.710614 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 27 18:55:53.710614 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 27 18:55:53.710614 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 27 18:55:53.710614 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fd570acf-5ec4-4591-9710-308ffb0901f2 is already attached to instances: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 Jun 27 18:55:53.710614 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:55:53.710614 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:55:53.710614 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:55:53.710614 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:55:53.712134 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:55:53.712134 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:55:53.712134 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:55:53.712134 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:55:53.712134 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:55:53.712134 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:55:53.712134 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 18:55:53.712134 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 18:55:53.712134 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 18:55:53.712134 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 18:55:53.712134 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 18:55:53.712134 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 18:55:53.712134 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 27 18:55:53.712134 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 27 18:55:53.712134 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fd570acf-5ec4-4591-9710-308ffb0901f2 is already attached to instances: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 Jun 27 18:55:53.712134 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:55:53.712134 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:55:53.712134 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:55:53.712134 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:55:53.712134 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:55:53.714686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:55:53.714686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:55:53.714686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:55:53.714686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fd570acf-5ec4-4591-9710-308ffb0901f2 is already attached to instances: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 Jun 27 18:55:53.714686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:55:53.714686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-4a33f44f-250d-4c0a-a7c8-c8a8114d3533 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Returning 400 to user: Invalid volume: volume fd570acf-5ec4-4591-9710-308ffb0901f2 is already attached to instances: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:55:53.714686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-4a33f44f-250d-4c0a-a7c8-c8a8114d3533 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "POST /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095216 Jun 27 18:55:53.714686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 524/1028] 10.222.0.15 () {60 vars in 1322 bytes} [Mon Jun 27 18:55:53 2022] POST /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 27 18:55:53.772375 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-f89d1ee6-1e62-4cfb-9bf7-3484ab80ea6f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:53.772888 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-f89d1ee6-1e62-4cfb-9bf7-3484ab80ea6f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:53.779955 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f89d1ee6-1e62-4cfb-9bf7-3484ab80ea6f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:53.780412 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f89d1ee6-1e62-4cfb-9bf7-3484ab80ea6f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:53.781178 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f89d1ee6-1e62-4cfb-9bf7-3484ab80ea6f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:53.781621 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f89d1ee6-1e62-4cfb-9bf7-3484ab80ea6f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:53.903766 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.objects.instance [None req-f89d1ee6-1e62-4cfb-9bf7-3484ab80ea6f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lazy-loading 'services' on Instance uuid d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 {{(pid=124717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:55:54.137407 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-f89d1ee6-1e62-4cfb-9bf7-3484ab80ea6f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5/os-volume_attachments/fd570acf-5ec4-4591-9710-308ffb0901f2" status: 202 len: 0 microversion: 2.1 time: 0.369162 Jun 27 18:55:54.138003 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 505/1029] 10.222.0.15 () {58 vars in 1415 bytes} [Mon Jun 27 18:55:53 2022] DELETE /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5/os-volume_attachments/fd570acf-5ec4-4591-9710-308ffb0901f2 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:55:54.146533 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-27cdd431-7177-4039-aab9-1ed826a35921 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:54.148454 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-27cdd431-7177-4039-aab9-1ed826a35921 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:54.155137 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-27cdd431-7177-4039-aab9-1ed826a35921 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:54.155593 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-27cdd431-7177-4039-aab9-1ed826a35921 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:54.156364 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-27cdd431-7177-4039-aab9-1ed826a35921 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:54.156800 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-27cdd431-7177-4039-aab9-1ed826a35921 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:54.186942 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-27cdd431-7177-4039-aab9-1ed826a35921 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044337 Jun 27 18:55:54.187503 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 525/1030] 10.222.0.15 () {58 vars in 1301 bytes} [Mon Jun 27 18:55:54 2022] GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:55:55.199352 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-2114ff8b-c027-47a7-bcff-50381f80722e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:55.200428 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-2114ff8b-c027-47a7-bcff-50381f80722e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:55.207171 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2114ff8b-c027-47a7-bcff-50381f80722e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:55.207634 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2114ff8b-c027-47a7-bcff-50381f80722e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:55.208394 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2114ff8b-c027-47a7-bcff-50381f80722e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:55.208858 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2114ff8b-c027-47a7-bcff-50381f80722e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:55.238129 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-2114ff8b-c027-47a7-bcff-50381f80722e tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043715 Jun 27 18:55:55.238715 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 506/1031] 10.222.0.15 () {58 vars in 1301 bytes} [Mon Jun 27 18:55:55 2022] GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 18:55:55.296933 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-d5be62eb-a7de-4e82-b1c3-76c3a4061078 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:55.297448 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-d5be62eb-a7de-4e82-b1c3-76c3a4061078 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:55.303884 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d5be62eb-a7de-4e82-b1c3-76c3a4061078 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:55.304345 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d5be62eb-a7de-4e82-b1c3-76c3a4061078 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:55.305106 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d5be62eb-a7de-4e82-b1c3-76c3a4061078 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:55.305544 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d5be62eb-a7de-4e82-b1c3-76c3a4061078 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:55.330525 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-d5be62eb-a7de-4e82-b1c3-76c3a4061078 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Going to try to terminate instance {{(pid=124716) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 18:55:55.586477 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-d5be62eb-a7de-4e82-b1c3-76c3a4061078 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5" status: 204 len: 0 microversion: 2.1 time: 0.293094 Jun 27 18:55:55.587070 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 526/1032] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:55:55 2022] DELETE /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 18:55:55.595800 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-7c7615f5-1a6b-4451-8616-875bf00df3fe tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:55.600449 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-7c7615f5-1a6b-4451-8616-875bf00df3fe tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:55.602590 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7c7615f5-1a6b-4451-8616-875bf00df3fe tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:55.603046 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7c7615f5-1a6b-4451-8616-875bf00df3fe tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:55.604461 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7c7615f5-1a6b-4451-8616-875bf00df3fe tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:55.604911 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-7c7615f5-1a6b-4451-8616-875bf00df3fe tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:55.739164 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-7c7615f5-1a6b-4451-8616-875bf00df3fe tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:55:55.747161 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-7c7615f5-1a6b-4451-8616-875bf00df3fe tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5" status: 200 len: 1683 microversion: 2.1 time: 0.155296 Jun 27 18:55:55.747745 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 507/1033] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:55:55 2022] GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:55:56.765944 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-bcd850f0-d702-4cfd-b934-daff8c5072ef tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:56.766693 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-bcd850f0-d702-4cfd-b934-daff8c5072ef tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:56.773129 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bcd850f0-d702-4cfd-b934-daff8c5072ef tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:56.773583 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bcd850f0-d702-4cfd-b934-daff8c5072ef tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:56.774349 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bcd850f0-d702-4cfd-b934-daff8c5072ef tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:56.774813 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-bcd850f0-d702-4cfd-b934-daff8c5072ef tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:56.911032 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-bcd850f0-d702-4cfd-b934-daff8c5072ef tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:55:56.919578 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-bcd850f0-d702-4cfd-b934-daff8c5072ef tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5" status: 200 len: 1683 microversion: 2.1 time: 0.157775 Jun 27 18:55:56.921202 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 527/1034] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:55:56 2022] GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:55:57.937157 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-30a67bed-0192-424a-9e04-70551b818906 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:57.937777 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-30a67bed-0192-424a-9e04-70551b818906 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:57.944328 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-30a67bed-0192-424a-9e04-70551b818906 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:57.944780 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-30a67bed-0192-424a-9e04-70551b818906 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:57.945549 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-30a67bed-0192-424a-9e04-70551b818906 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:57.945986 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-30a67bed-0192-424a-9e04-70551b818906 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:58.008112 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-30a67bed-0192-424a-9e04-70551b818906 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:55:58.016345 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-30a67bed-0192-424a-9e04-70551b818906 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5" status: 200 len: 1615 microversion: 2.1 time: 0.083003 Jun 27 18:55:58.016923 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 508/1035] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:55:57 2022] GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 => generated 1615 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:55:58.296584 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-e795ab9f-e8a6-48b6-bea1-4f1a6dd8081e req-e8fad9c2-75ed-42b0-8cb6-39275c988702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5", "name": "network-vif-deleted", "tag": "9fc5cc89-09ba-40af-b959-14a896bd1805"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:55:58.305231 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-e795ab9f-e8a6-48b6-bea1-4f1a6dd8081e req-e8fad9c2-75ed-42b0-8cb6-39275c988702 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:58.306153 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-e795ab9f-e8a6-48b6-bea1-4f1a6dd8081e req-e8fad9c2-75ed-42b0-8cb6-39275c988702 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:58.318918 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-e795ab9f-e8a6-48b6-bea1-4f1a6dd8081e req-e8fad9c2-75ed-42b0-8cb6-39275c988702 service nova] Creating event network-vif-deleted:9fc5cc89-09ba-40af-b959-14a896bd1805 for instance d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 on hv-cinder-84460 Jun 27 18:55:58.325845 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-e795ab9f-e8a6-48b6-bea1-4f1a6dd8081e req-e8fad9c2-75ed-42b0-8cb6-39275c988702 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.251772 Jun 27 18:55:58.328192 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 528/1036] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:55:59.033475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-02aa44e5-00dd-45f3-b443-911093081995 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:59.034141 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-02aa44e5-00dd-45f3-b443-911093081995 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:55:59.043327 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-02aa44e5-00dd-45f3-b443-911093081995 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:59.043783 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-02aa44e5-00dd-45f3-b443-911093081995 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:59.044571 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-02aa44e5-00dd-45f3-b443-911093081995 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:55:59.045011 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-02aa44e5-00dd-45f3-b443-911093081995 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:55:59.059843 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-02aa44e5-00dd-45f3-b443-911093081995 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] HTTP exception thrown: Instance d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 could not be found. Jun 27 18:55:59.061510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-02aa44e5-00dd-45f3-b443-911093081995 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Request method failure captured: Jun 27 18:55:59.061510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 HTTP/1.1 Jun 27 18:55:59.061510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 18:55:59.061510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 18:55:59.061510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 18:55:59.061510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 0 Jun 27 18:55:59.061510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 18:55:59.061510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 18:55:59.061510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 18:55:59.061510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 18:55:59.061510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufxujj71f0JcK6xynWFlkvJylD3VaW76hhLj6aYJdaIU72emt5fWMZbhrMQMXmzSnlN7izfTbQz8DDDms1aAEVEIobTTP_Qgn0UA0fG5dAYGKFUUdOXMjzqUBw4nwaAUQKw-YAQrfZf2wWTIXVqD3NfGLb3EDQz_tkmxCaoeCzMl1tQ Jun 27 18:55:59.061510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 18:55:59.061510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 18:55:59.061510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 18:55:59.061510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 18:55:59.061510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 18:55:59.061510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 18:55:59.061510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:55:59.061510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:55:59.061510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 18:55:59.061510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 18:55:59.063359 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:55:59.063359 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:55:59.063359 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:55:59.063359 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:55:59.063359 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:55:59.063359 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 18:55:59.063359 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 18:55:59.063359 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: 48ac761d30de4fb49478a78ccf23ab92 Jun 27 18:55:59.063359 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:55:59.063359 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: > Jun 27 18:55:59.063359 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Instance d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 could not be found. Jun 27 18:55:59.063359 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'id': 'd2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5'} Jun 27 18:55:59.064318 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:55:59.064318 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:55:59.064318 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:55:59.064318 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:55:59.064318 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:55:59.064318 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:55:59.064318 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:55:59.064318 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:55:59.064318 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:55:59.064318 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:55:59.064318 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 could not be found. Jun 27 18:55:59.064318 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:55:59.064318 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:55:59.064318 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:55:59.064318 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:55:59.064318 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:55:59.064318 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:55:59.064318 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:55:59.064318 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:55:59.064318 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:55:59.065845 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:55:59.065845 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:55:59.065845 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:55:59.065845 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:55:59.065845 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:55:59.065845 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:55:59.065845 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:55:59.065845 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 could not be found. Jun 27 18:55:59.065845 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:55:59.065845 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:55:59.065845 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:55:59.065845 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:55:59.065845 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:55:59.065845 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:55:59.065845 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:55:59.065845 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:55:59.065845 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 could not be found. Jun 27 18:55:59.065845 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:55:59.067280 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-02aa44e5-00dd-45f3-b443-911093081995 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Returning 404 to user: Instance d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 could not be found. {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:55:59.067280 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-02aa44e5-00dd-45f3-b443-911093081995 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5" status: 404 len: 111 microversion: 2.1 time: 0.033660 Jun 27 18:55:59.067280 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 509/1037] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:55:59 2022] GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:55:59.073576 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-9cd71c43-4c99-46e8-88d9-f3e1cd19751d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '.version_select at 0x7f700f5ff310>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:55:59.140068 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-9cd71c43-4c99-46e8-88d9-f3e1cd19751d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1328140047" status: 202 len: 0 microversion: 2.1 time: 0.071691 Jun 27 18:55:59.140545 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 529/1038] 10.222.0.15 () {58 vars in 1220 bytes} [Mon Jun 27 18:55:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1328140047 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:56:00.112210 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a5392ee5-0df4-4ee8-a64b-a965ca74eb52 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Action: 'create', calling method: .version_select at 0x7f700fe95700>, body: {"keypair": {"name": "tempest-keypair-970099115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCToKsrJS+JydagPw+q9VtUoHz71nLkgj1yCVkkICFgbhhCdM6cOXJaEn8mm02WR4+3lg4CWYOnqBjKB0W018oeLNEdHqeS6+H5RsxWMgbdCQAcKg/CGxzazJn16r5ALA=="}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:56:00.127396 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-a5392ee5-0df4-4ee8-a64b-a965ca74eb52 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Getting quotas for project a981ae734b1e4993bb440918b1a74fe7. Resources: {'key_pairs'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:56:00.131170 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.quota [None req-a5392ee5-0df4-4ee8-a64b-a965ca74eb52 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Getting quotas for user 48ac761d30de4fb49478a78ccf23ab92 and project a981ae734b1e4993bb440918b1a74fe7. Resources: {'key_pairs'} {{(pid=124717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:56:00.210529 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-a5392ee5-0df4-4ee8-a64b-a965ca74eb52 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.102126 Jun 27 18:56:00.211142 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 510/1039] 10.222.0.15 () {60 vars in 1158 bytes} [Mon Jun 27 18:56:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:56:01.160471 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-34d59b83-3e57-4e57-a3c0-df1cbddf345e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:01.161200 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-34d59b83-3e57-4e57-a3c0-df1cbddf345e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:01.168428 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-34d59b83-3e57-4e57-a3c0-df1cbddf345e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:01.168857 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-34d59b83-3e57-4e57-a3c0-df1cbddf345e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:01.169613 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-34d59b83-3e57-4e57-a3c0-df1cbddf345e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:01.170048 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-34d59b83-3e57-4e57-a3c0-df1cbddf345e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:01.194078 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-34d59b83-3e57-4e57-a3c0-df1cbddf345e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Going to try to terminate instance {{(pid=124716) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 18:56:01.481469 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-34d59b83-3e57-4e57-a3c0-df1cbddf345e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "DELETE /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 204 len: 0 microversion: 2.1 time: 0.325212 Jun 27 18:56:01.482089 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 530/1040] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:56:01 2022] DELETE /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 18:56:01.490163 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-2abfe92c-5364-4305-b29a-c1c1769b238a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:01.491192 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-2abfe92c-5364-4305-b29a-c1c1769b238a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:01.499671 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2abfe92c-5364-4305-b29a-c1c1769b238a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:01.500121 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2abfe92c-5364-4305-b29a-c1c1769b238a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:01.500879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2abfe92c-5364-4305-b29a-c1c1769b238a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:01.501318 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2abfe92c-5364-4305-b29a-c1c1769b238a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:01.639458 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-2abfe92c-5364-4305-b29a-c1c1769b238a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:01.646936 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-2abfe92c-5364-4305-b29a-c1c1769b238a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 200 len: 1580 microversion: 2.1 time: 0.160642 Jun 27 18:56:01.647677 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 511/1041] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:01 2022] GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 1580 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:02.339609 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-1a367d5b-db86-458f-8bb2-7449e2b02826 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-308298941", "imageRef": "c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "580ec2de-be59-4921-adbe-91c7f9d3a376"}], "security_groups": [{"name": "tempest-securitygroup--81630892"}], "key_name": "tempest-keypair-970099115", "user_data": "}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:56:02.441231 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.network.neutron [None req-1a367d5b-db86-458f-8bb2-7449e2b02826 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] validate_networks() for [('580ec2de-be59-4921-adbe-91c7f9d3a376', None, None, None, None, None)] {{(pid=124716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 18:56:02.665258 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-f0c8a3db-139b-4844-a85d-d8d5be814583 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:02.665882 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-f0c8a3db-139b-4844-a85d-d8d5be814583 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:02.673126 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f0c8a3db-139b-4844-a85d-d8d5be814583 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:02.673591 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f0c8a3db-139b-4844-a85d-d8d5be814583 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:02.674353 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f0c8a3db-139b-4844-a85d-d8d5be814583 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:02.674813 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-f0c8a3db-139b-4844-a85d-d8d5be814583 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:02.885530 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-f0c8a3db-139b-4844-a85d-d8d5be814583 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:02.887326 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-1a367d5b-db86-458f-8bb2-7449e2b02826 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Flavor limits 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 18:56:02.887757 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-1a367d5b-db86-458f-8bb2-7449e2b02826 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Image limits 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 18:56:02.888240 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-1a367d5b-db86-458f-8bb2-7449e2b02826 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Flavor pref 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 18:56:02.888655 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-1a367d5b-db86-458f-8bb2-7449e2b02826 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Image pref 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 18:56:02.889072 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-1a367d5b-db86-458f-8bb2-7449e2b02826 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 18:56:02.893261 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-f0c8a3db-139b-4844-a85d-d8d5be814583 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 200 len: 1580 microversion: 2.1 time: 0.231963 Jun 27 18:56:02.893912 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 512/1042] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:02 2022] GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 1580 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:56:02.897975 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1a367d5b-db86-458f-8bb2-7449e2b02826 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:02.898455 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1a367d5b-db86-458f-8bb2-7449e2b02826 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:02.899262 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1a367d5b-db86-458f-8bb2-7449e2b02826 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:02.899703 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1a367d5b-db86-458f-8bb2-7449e2b02826 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:02.917555 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-1a367d5b-db86-458f-8bb2-7449e2b02826 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Getting quotas for project a981ae734b1e4993bb440918b1a74fe7. Resources: {'ram', 'cores', 'instances'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:56:02.921507 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-1a367d5b-db86-458f-8bb2-7449e2b02826 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Getting quotas for user 48ac761d30de4fb49478a78ccf23ab92 and project a981ae734b1e4993bb440918b1a74fe7. Resources: {'ram', 'cores', 'instances'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:56:02.932526 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-1a367d5b-db86-458f-8bb2-7449e2b02826 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Going to run 1 instances... {{(pid=124716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 18:56:02.934908 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-1a367d5b-db86-458f-8bb2-7449e2b02826 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5e88c5b-4bbd-4ca1-9058-0e6b3dc12ce3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 18:56:03.066448 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-1a367d5b-db86-458f-8bb2-7449e2b02826 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.731377 Jun 27 18:56:03.067268 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 531/1043] 10.222.0.15 () {60 vars in 1146 bytes} [Mon Jun 27 18:56:02 2022] POST /compute/v2.1/servers => generated 400 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 18:56:03.077168 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-168ef9c5-ead5-48f4-a5bd-fdd2d012b16b tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:03.077792 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-168ef9c5-ead5-48f4-a5bd-fdd2d012b16b tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:03.150157 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-168ef9c5-ead5-48f4-a5bd-fdd2d012b16b tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:03.159285 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-168ef9c5-ead5-48f4-a5bd-fdd2d012b16b tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944" status: 200 len: 1240 microversion: 2.1 time: 0.085882 Jun 27 18:56:03.159859 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 513/1044] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:03 2022] GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:03.911213 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-cb9ab5d8-ff65-44ff-a8bd-90d7f75e72f5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:03.911860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-cb9ab5d8-ff65-44ff-a8bd-90d7f75e72f5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:03.921405 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cb9ab5d8-ff65-44ff-a8bd-90d7f75e72f5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:03.921862 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cb9ab5d8-ff65-44ff-a8bd-90d7f75e72f5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:03.922668 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cb9ab5d8-ff65-44ff-a8bd-90d7f75e72f5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:03.923202 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-cb9ab5d8-ff65-44ff-a8bd-90d7f75e72f5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:03.933419 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-0ef8fe1d-eb92-4696-9065-0f6cfd0fedf6 req-261ce4f5-d6da-452b-9a59-1bba430621c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "969bb23c-9265-497a-b68a-70193be0b3f1", "name": "network-vif-deleted", "tag": "ea87b613-5cf7-4cd4-bbcb-2b7f807732c0"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:56:04.018610 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-cb9ab5d8-ff65-44ff-a8bd-90d7f75e72f5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:04.032544 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-cb9ab5d8-ff65-44ff-a8bd-90d7f75e72f5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 200 len: 1512 microversion: 2.1 time: 0.125158 Jun 27 18:56:04.033317 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 532/1045] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:03 2022] GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 1512 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:04.140636 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-0ef8fe1d-eb92-4696-9065-0f6cfd0fedf6 req-261ce4f5-d6da-452b-9a59-1bba430621c4 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:04.141767 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-0ef8fe1d-eb92-4696-9065-0f6cfd0fedf6 req-261ce4f5-d6da-452b-9a59-1bba430621c4 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:04.152782 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-0ef8fe1d-eb92-4696-9065-0f6cfd0fedf6 req-261ce4f5-d6da-452b-9a59-1bba430621c4 service nova] Creating event network-vif-deleted:ea87b613-5cf7-4cd4-bbcb-2b7f807732c0 for instance 969bb23c-9265-497a-b68a-70193be0b3f1 on hv-cinder-84460 Jun 27 18:56:04.157658 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-0ef8fe1d-eb92-4696-9065-0f6cfd0fedf6 req-261ce4f5-d6da-452b-9a59-1bba430621c4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228332 Jun 27 18:56:04.158257 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 514/1046] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:56:04.175778 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-b2caf456-3a96-450d-9722-d1f69247a081 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:04.176398 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-b2caf456-3a96-450d-9722-d1f69247a081 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:04.232553 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-b2caf456-3a96-450d-9722-d1f69247a081 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:04.240292 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-b2caf456-3a96-450d-9722-d1f69247a081 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944" status: 200 len: 1240 microversion: 2.1 time: 0.068336 Jun 27 18:56:04.241369 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 533/1047] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:04 2022] GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:05.050947 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-d41eef5a-cc7a-42eb-a61f-c6f7f529049e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:05.051704 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-d41eef5a-cc7a-42eb-a61f-c6f7f529049e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:05.061786 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d41eef5a-cc7a-42eb-a61f-c6f7f529049e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:05.062253 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d41eef5a-cc7a-42eb-a61f-c6f7f529049e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:05.063179 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d41eef5a-cc7a-42eb-a61f-c6f7f529049e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:05.063630 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d41eef5a-cc7a-42eb-a61f-c6f7f529049e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:05.094587 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d41eef5a-cc7a-42eb-a61f-c6f7f529049e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:05.095044 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d41eef5a-cc7a-42eb-a61f-c6f7f529049e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:05.095496 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.objects.instance [None req-d41eef5a-cc7a-42eb-a61f-c6f7f529049e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lazy-loading 'fault' on Instance uuid 969bb23c-9265-497a-b68a-70193be0b3f1 {{(pid=124717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:56:05.137562 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-d41eef5a-cc7a-42eb-a61f-c6f7f529049e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:05.145354 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-d41eef5a-cc7a-42eb-a61f-c6f7f529049e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 200 len: 1231 microversion: 2.1 time: 0.099533 Jun 27 18:56:05.145937 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 515/1048] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:05 2022] GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:05.258044 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-45d8c7d6-a010-4bb5-8183-98394432af55 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:05.258701 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-45d8c7d6-a010-4bb5-8183-98394432af55 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:05.266729 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-45d8c7d6-a010-4bb5-8183-98394432af55 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:05.267176 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-45d8c7d6-a010-4bb5-8183-98394432af55 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:05.268006 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-45d8c7d6-a010-4bb5-8183-98394432af55 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:05.268444 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-45d8c7d6-a010-4bb5-8183-98394432af55 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:05.332749 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-45d8c7d6-a010-4bb5-8183-98394432af55 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:05.341314 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-45d8c7d6-a010-4bb5-8183-98394432af55 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944" status: 200 len: 1300 microversion: 2.1 time: 0.087200 Jun 27 18:56:05.351489 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 534/1049] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:05 2022] GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944 => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:06.162629 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0ef3d4b3-c330-4f80-9e41-269b897acd64 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:06.168422 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-0ef3d4b3-c330-4f80-9e41-269b897acd64 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:06.171286 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0ef3d4b3-c330-4f80-9e41-269b897acd64 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:06.171745 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0ef3d4b3-c330-4f80-9e41-269b897acd64 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:06.172655 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0ef3d4b3-c330-4f80-9e41-269b897acd64 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:06.173026 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-0ef3d4b3-c330-4f80-9e41-269b897acd64 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:06.188138 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-0ef3d4b3-c330-4f80-9e41-269b897acd64 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] HTTP exception thrown: Instance 969bb23c-9265-497a-b68a-70193be0b3f1 could not be found. Jun 27 18:56:06.192588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0ef3d4b3-c330-4f80-9e41-269b897acd64 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Request method failure captured: Jun 27 18:56:06.192588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 HTTP/1.1 Jun 27 18:56:06.192588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 18:56:06.192588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 18:56:06.192588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 18:56:06.192588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 0 Jun 27 18:56:06.192588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 18:56:06.192588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 18:56:06.192588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 18:56:06.192588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 18:56:06.192588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufyWEjJov3JiU-YrLnGIA-MtRkVnK36MM3Ev0CxpUUs5JXBejK5bS4jy4vO4aWP1DSRdHS7A-cmf1gda5kTIC1ni20jGE9ZSSLpqjqRuJ1NMKOpUux-izX42ZMVXcqmOqbBASExCJXHVOPCk2rNiLhag2AFIXSh4x53KMuBgfbEdjEE Jun 27 18:56:06.192588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 18:56:06.192588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 18:56:06.192588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 18:56:06.192588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 18:56:06.192588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 18:56:06.192588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 18:56:06.192588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: 302e8c5b4c1f422fbd5cf5602a094d2e Jun 27 18:56:06.192588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-TestVolumeBootPattern-178305863 Jun 27 18:56:06.192588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 18:56:06.192588 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 18:56:06.194229 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/302e8c5b4c1f422fbd5cf5602a094d2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/302e8c5b4c1f422fbd5cf5602a094d2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_302e8c5b4c1f422fbd5cf5602a094d2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/302e8c5b4c1f422fbd5cf5602a094d2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:56:06.194229 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-TestVolumeBootPattern-178305863 Jun 27 18:56:06.194229 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: 302e8c5b4c1f422fbd5cf5602a094d2e Jun 27 18:56:06.194229 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-TestVolumeBootPattern-178305863 Jun 27 18:56:06.194229 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-TestVolumeBootPattern-178305863-project Jun 27 18:56:06.194229 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 18:56:06.194229 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 18:56:06.194229 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: b10a90cce1b048d7bd55938811301ab4 Jun 27 18:56:06.194229 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-TestVolumeBootPattern-178305863-project Jun 27 18:56:06.194229 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: > Jun 27 18:56:06.194229 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Instance 969bb23c-9265-497a-b68a-70193be0b3f1 could not be found. Jun 27 18:56:06.194229 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'id': '969bb23c-9265-497a-b68a-70193be0b3f1'} Jun 27 18:56:06.195242 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:56:06.195242 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:56:06.195242 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:56:06.195242 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:56:06.195242 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:56:06.195242 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:56:06.195242 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:56:06.195242 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:56:06.195242 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:56:06.195242 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:56:06.195242 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 969bb23c-9265-497a-b68a-70193be0b3f1 could not be found. Jun 27 18:56:06.195242 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:56:06.195242 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:56:06.195242 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:56:06.195242 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:56:06.195242 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:56:06.195242 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:56:06.195242 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:56:06.195242 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:56:06.195242 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:56:06.196804 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:56:06.196804 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:56:06.196804 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:56:06.196804 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:56:06.196804 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:56:06.196804 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:56:06.196804 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:56:06.196804 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 969bb23c-9265-497a-b68a-70193be0b3f1 could not be found. Jun 27 18:56:06.196804 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:56:06.196804 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:56:06.196804 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:56:06.196804 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:56:06.196804 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:56:06.196804 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:56:06.196804 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:56:06.196804 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:56:06.196804 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 969bb23c-9265-497a-b68a-70193be0b3f1 could not be found. Jun 27 18:56:06.196804 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:56:06.198288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-0ef3d4b3-c330-4f80-9e41-269b897acd64 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Returning 404 to user: Instance 969bb23c-9265-497a-b68a-70193be0b3f1 could not be found. {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:56:06.198288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-0ef3d4b3-c330-4f80-9e41-269b897acd64 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 404 len: 111 microversion: 2.1 time: 0.032702 Jun 27 18:56:06.198288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 516/1050] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:06 2022] GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:56:06.303173 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-1ee02cf2-853b-496e-af62-496fd0c23eee tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-782930771", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1210628940", "security_groups": [{"name": "tempest-secgroup-smoke-1765541639"}], "block_device_mapping_v2": [{"uuid": "45376225-64b9-4d1f-a699-9639ef272105", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "258993d8-d320-41d5-9b9f-c929b6912ace"}]}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:56:06.362687 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-03b58470-ea94-4649-88fd-a6a308ff0a25 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:06.363751 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-03b58470-ea94-4649-88fd-a6a308ff0a25 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:06.373208 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-03b58470-ea94-4649-88fd-a6a308ff0a25 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:06.374312 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-03b58470-ea94-4649-88fd-a6a308ff0a25 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:06.375789 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-03b58470-ea94-4649-88fd-a6a308ff0a25 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:06.376450 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-03b58470-ea94-4649-88fd-a6a308ff0a25 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:06.443027 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.network.neutron [None req-1ee02cf2-853b-496e-af62-496fd0c23eee tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] validate_networks() for [('258993d8-d320-41d5-9b9f-c929b6912ace', None, None, None, None, None)] {{(pid=124716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 18:56:06.625139 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-03b58470-ea94-4649-88fd-a6a308ff0a25 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:06.635315 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-03b58470-ea94-4649-88fd-a6a308ff0a25 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944" status: 200 len: 1364 microversion: 2.1 time: 0.276821 Jun 27 18:56:06.635886 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 517/1051] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:06 2022] GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944 => generated 1364 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:06.885792 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-1ee02cf2-853b-496e-af62-496fd0c23eee tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Flavor limits 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 18:56:06.886218 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-1ee02cf2-853b-496e-af62-496fd0c23eee tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Image limits 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 18:56:06.886788 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-1ee02cf2-853b-496e-af62-496fd0c23eee tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Flavor pref 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 18:56:06.887411 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-1ee02cf2-853b-496e-af62-496fd0c23eee tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Image pref 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 18:56:06.888006 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-1ee02cf2-853b-496e-af62-496fd0c23eee tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 18:56:06.897514 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1ee02cf2-853b-496e-af62-496fd0c23eee tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:06.897973 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1ee02cf2-853b-496e-af62-496fd0c23eee tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:06.898826 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1ee02cf2-853b-496e-af62-496fd0c23eee tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:06.899487 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-1ee02cf2-853b-496e-af62-496fd0c23eee tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:06.919346 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-1ee02cf2-853b-496e-af62-496fd0c23eee tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Getting quotas for project 302e8c5b4c1f422fbd5cf5602a094d2e. Resources: {'ram', 'cores', 'instances'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:56:06.923643 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-1ee02cf2-853b-496e-af62-496fd0c23eee tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Getting quotas for user b10a90cce1b048d7bd55938811301ab4 and project 302e8c5b4c1f422fbd5cf5602a094d2e. Resources: {'ram', 'cores', 'instances'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:56:06.987933 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-1ee02cf2-853b-496e-af62-496fd0c23eee tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Going to run 1 instances... {{(pid=124716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 18:56:06.989963 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-1ee02cf2-853b-496e-af62-496fd0c23eee tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 16771a29-9fe8-4864-968e-645bc86cc969] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='45376225-64b9-4d1f-a699-9639ef272105',volume_size=None,volume_type=None)] {{(pid=124716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 18:56:07.167930 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-7a50d349-5830-4ca1-9181-f2495c1b5f2b req-28086bbf-933f-43e0-87bc-b35dd2791752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "538c87a8-e075-4a53-8b4c-11b8dd7db944", "tag": "c9eb5679-413d-47ff-a674-aa77c9e8ef04"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:56:07.176391 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-7a50d349-5830-4ca1-9181-f2495c1b5f2b req-28086bbf-933f-43e0-87bc-b35dd2791752 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:07.176833 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-7a50d349-5830-4ca1-9181-f2495c1b5f2b req-28086bbf-933f-43e0-87bc-b35dd2791752 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:07.190251 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-7a50d349-5830-4ca1-9181-f2495c1b5f2b req-28086bbf-933f-43e0-87bc-b35dd2791752 service nova] Creating event network-changed:c9eb5679-413d-47ff-a674-aa77c9e8ef04 for instance 538c87a8-e075-4a53-8b4c-11b8dd7db944 on hv-cinder-84460 Jun 27 18:56:07.195009 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-7a50d349-5830-4ca1-9181-f2495c1b5f2b req-28086bbf-933f-43e0-87bc-b35dd2791752 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031473 Jun 27 18:56:07.195541 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 518/1052] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:56:07.411570 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-1ee02cf2-853b-496e-af62-496fd0c23eee tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.112275 Jun 27 18:56:07.417297 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 535/1053] 10.222.0.15 () {60 vars in 1146 bytes} [Mon Jun 27 18:56:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 18:56:07.423568 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a96e0122-054e-4e70-b5c1-486590fddcc8 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:07.424691 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-a96e0122-054e-4e70-b5c1-486590fddcc8 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 16771a29-9fe8-4864-968e-645bc86cc969] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:07.497320 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a96e0122-054e-4e70-b5c1-486590fddcc8 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:07.506075 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-a96e0122-054e-4e70-b5c1-486590fddcc8 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969" status: 200 len: 1094 microversion: 2.1 time: 0.085516 Jun 27 18:56:07.506511 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 519/1054] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:07 2022] GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969 => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:07.652365 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-2aca59cd-8ad9-4ce0-9e45-2798f282b994 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:07.652988 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-2aca59cd-8ad9-4ce0-9e45-2798f282b994 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:07.660354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2aca59cd-8ad9-4ce0-9e45-2798f282b994 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:07.660798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2aca59cd-8ad9-4ce0-9e45-2798f282b994 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:07.661613 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2aca59cd-8ad9-4ce0-9e45-2798f282b994 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:07.662032 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2aca59cd-8ad9-4ce0-9e45-2798f282b994 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:07.836383 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-2aca59cd-8ad9-4ce0-9e45-2798f282b994 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:07.846417 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-2aca59cd-8ad9-4ce0-9e45-2798f282b994 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944" status: 200 len: 1364 microversion: 2.1 time: 0.197786 Jun 27 18:56:07.850073 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 536/1055] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:07 2022] GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944 => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:08.522673 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-71ca50c4-ab78-44a3-b64f-4eff01bc832e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:08.523206 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-71ca50c4-ab78-44a3-b64f-4eff01bc832e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 16771a29-9fe8-4864-968e-645bc86cc969] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:08.531034 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-71ca50c4-ab78-44a3-b64f-4eff01bc832e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:08.531483 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-71ca50c4-ab78-44a3-b64f-4eff01bc832e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:08.532242 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-71ca50c4-ab78-44a3-b64f-4eff01bc832e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:08.532681 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-71ca50c4-ab78-44a3-b64f-4eff01bc832e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:08.592921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-71ca50c4-ab78-44a3-b64f-4eff01bc832e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:08.600252 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-71ca50c4-ab78-44a3-b64f-4eff01bc832e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969" status: 200 len: 1144 microversion: 2.1 time: 0.081564 Jun 27 18:56:08.600806 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 520/1056] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:08 2022] GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:08.863580 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-6dbe62ca-7b31-443d-b6bb-0fb27f68dd25 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:08.864202 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-6dbe62ca-7b31-443d-b6bb-0fb27f68dd25 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:08.871640 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6dbe62ca-7b31-443d-b6bb-0fb27f68dd25 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:08.872087 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6dbe62ca-7b31-443d-b6bb-0fb27f68dd25 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:08.872839 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6dbe62ca-7b31-443d-b6bb-0fb27f68dd25 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:08.873460 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6dbe62ca-7b31-443d-b6bb-0fb27f68dd25 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:09.005627 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-6dbe62ca-7b31-443d-b6bb-0fb27f68dd25 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:09.013215 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-6dbe62ca-7b31-443d-b6bb-0fb27f68dd25 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944" status: 200 len: 1364 microversion: 2.1 time: 0.153505 Jun 27 18:56:09.013791 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 537/1057] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:08 2022] GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:09.617287 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-cb5367e0-6fac-4c35-a34e-2a232a155f80 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:09.617911 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-cb5367e0-6fac-4c35-a34e-2a232a155f80 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 16771a29-9fe8-4864-968e-645bc86cc969] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:09.625094 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cb5367e0-6fac-4c35-a34e-2a232a155f80 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:09.625543 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cb5367e0-6fac-4c35-a34e-2a232a155f80 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:09.626316 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cb5367e0-6fac-4c35-a34e-2a232a155f80 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:09.626779 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-cb5367e0-6fac-4c35-a34e-2a232a155f80 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:09.700727 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-cb5367e0-6fac-4c35-a34e-2a232a155f80 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:09.708736 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-cb5367e0-6fac-4c35-a34e-2a232a155f80 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969" status: 200 len: 1200 microversion: 2.1 time: 0.095449 Jun 27 18:56:09.709302 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 521/1058] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:09 2022] GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969 => generated 1200 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 18:56:10.030701 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-d99c1a63-2d36-4b10-9570-ecd66913c6c1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:10.032570 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-d99c1a63-2d36-4b10-9570-ecd66913c6c1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:10.038428 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d99c1a63-2d36-4b10-9570-ecd66913c6c1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:10.040403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d99c1a63-2d36-4b10-9570-ecd66913c6c1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:10.040403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d99c1a63-2d36-4b10-9570-ecd66913c6c1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:10.040403 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d99c1a63-2d36-4b10-9570-ecd66913c6c1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:10.187601 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-d99c1a63-2d36-4b10-9570-ecd66913c6c1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:10.197213 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-d99c1a63-2d36-4b10-9570-ecd66913c6c1 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944" status: 200 len: 1364 microversion: 2.1 time: 0.170299 Jun 27 18:56:10.199070 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 538/1059] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:10 2022] GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:10.731406 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-02df9e59-187c-4df5-a78e-5acf4efca699 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:10.731940 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-02df9e59-187c-4df5-a78e-5acf4efca699 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 16771a29-9fe8-4864-968e-645bc86cc969] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:10.738755 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-02df9e59-187c-4df5-a78e-5acf4efca699 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:10.739208 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-02df9e59-187c-4df5-a78e-5acf4efca699 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:10.739988 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-02df9e59-187c-4df5-a78e-5acf4efca699 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:10.740427 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-02df9e59-187c-4df5-a78e-5acf4efca699 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:10.880364 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-02df9e59-187c-4df5-a78e-5acf4efca699 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:10.888631 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-02df9e59-187c-4df5-a78e-5acf4efca699 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969" status: 200 len: 1278 microversion: 2.1 time: 0.162083 Jun 27 18:56:10.889221 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 522/1060] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:10 2022] GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969 => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:11.215844 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-ad5c6349-1e5c-4a39-bc3c-c7cdb81a064d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:11.216839 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-ad5c6349-1e5c-4a39-bc3c-c7cdb81a064d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:11.227720 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ad5c6349-1e5c-4a39-bc3c-c7cdb81a064d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:11.228151 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ad5c6349-1e5c-4a39-bc3c-c7cdb81a064d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:11.229753 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ad5c6349-1e5c-4a39-bc3c-c7cdb81a064d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:11.230198 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ad5c6349-1e5c-4a39-bc3c-c7cdb81a064d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:11.232986 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-e2187cd4-6f64-4129-bd62-beb9c8b3c6bc req-b11ebc10-2088-452f-a456-387b64696d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16771a29-9fe8-4864-968e-645bc86cc969", "tag": "73b7ba71-0c22-43f7-a800-e4ea470160f2"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:56:11.248752 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-e2187cd4-6f64-4129-bd62-beb9c8b3c6bc req-b11ebc10-2088-452f-a456-387b64696d5d service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:11.251323 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-e2187cd4-6f64-4129-bd62-beb9c8b3c6bc req-b11ebc10-2088-452f-a456-387b64696d5d service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:11.265456 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-e2187cd4-6f64-4129-bd62-beb9c8b3c6bc req-b11ebc10-2088-452f-a456-387b64696d5d service nova] Creating event network-changed:73b7ba71-0c22-43f7-a800-e4ea470160f2 for instance 16771a29-9fe8-4864-968e-645bc86cc969 on hv-cinder-84460 Jun 27 18:56:11.274901 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-e2187cd4-6f64-4129-bd62-beb9c8b3c6bc req-b11ebc10-2088-452f-a456-387b64696d5d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046418 Jun 27 18:56:11.275595 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 523/1061] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:56:11.396694 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-ad5c6349-1e5c-4a39-bc3c-c7cdb81a064d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:11.418852 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-ad5c6349-1e5c-4a39-bc3c-c7cdb81a064d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944" status: 200 len: 1364 microversion: 2.1 time: 0.207844 Jun 27 18:56:11.419444 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 539/1062] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:11 2022] GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944 => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:11.906833 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-ceae10a6-8c73-4707-9d12-072f9720b759 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:11.908208 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-ceae10a6-8c73-4707-9d12-072f9720b759 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 16771a29-9fe8-4864-968e-645bc86cc969] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:11.914741 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ceae10a6-8c73-4707-9d12-072f9720b759 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:11.915184 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ceae10a6-8c73-4707-9d12-072f9720b759 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:11.916211 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ceae10a6-8c73-4707-9d12-072f9720b759 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:11.916640 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ceae10a6-8c73-4707-9d12-072f9720b759 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:11.937660 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:12.062377 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-ceae10a6-8c73-4707-9d12-072f9720b759 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:12.069923 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-ceae10a6-8c73-4707-9d12-072f9720b759 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969" status: 200 len: 1266 microversion: 2.1 time: 0.168128 Jun 27 18:56:12.085157 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-efdb6665-e1f8-4004-b3c4-641e528c1234 req-25306b6c-04c1-48b0-9a06-7cebceeaba2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "538c87a8-e075-4a53-8b4c-11b8dd7db944", "name": "network-vif-plugged", "status": "completed", "tag": "c9eb5679-413d-47ff-a674-aa77c9e8ef04"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:56:12.090322 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 524/1063] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:11 2022] GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:12.095242 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-efdb6665-e1f8-4004-b3c4-641e528c1234 req-25306b6c-04c1-48b0-9a06-7cebceeaba2a service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:12.095691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-efdb6665-e1f8-4004-b3c4-641e528c1234 req-25306b6c-04c1-48b0-9a06-7cebceeaba2a service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:12.099864 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:12.107608 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-efdb6665-e1f8-4004-b3c4-641e528c1234 req-25306b6c-04c1-48b0-9a06-7cebceeaba2a service nova] Creating event network-vif-plugged:c9eb5679-413d-47ff-a674-aa77c9e8ef04 for instance 538c87a8-e075-4a53-8b4c-11b8dd7db944 on hv-cinder-84460 Jun 27 18:56:12.112981 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-efdb6665-e1f8-4004-b3c4-641e528c1234 req-25306b6c-04c1-48b0-9a06-7cebceeaba2a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106688 Jun 27 18:56:12.114097 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 540/1064] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:56:12.437360 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-8d72453d-0442-4c01-a277-08e709be464a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:12.437978 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-8d72453d-0442-4c01-a277-08e709be464a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:12.443910 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8d72453d-0442-4c01-a277-08e709be464a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:12.444359 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8d72453d-0442-4c01-a277-08e709be464a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:12.445114 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8d72453d-0442-4c01-a277-08e709be464a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:12.445669 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8d72453d-0442-4c01-a277-08e709be464a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:12.583794 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-8d72453d-0442-4c01-a277-08e709be464a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:12.591214 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-8d72453d-0442-4c01-a277-08e709be464a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944" status: 200 len: 1364 microversion: 2.1 time: 0.159406 Jun 27 18:56:12.591854 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 525/1065] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:12 2022] GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:13.088590 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a7e129ba-99d7-4458-8233-fa70efd8dd3c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:13.089293 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a7e129ba-99d7-4458-8233-fa70efd8dd3c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 16771a29-9fe8-4864-968e-645bc86cc969] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:13.096098 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a7e129ba-99d7-4458-8233-fa70efd8dd3c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:13.096558 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a7e129ba-99d7-4458-8233-fa70efd8dd3c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:13.097321 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a7e129ba-99d7-4458-8233-fa70efd8dd3c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:13.097756 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a7e129ba-99d7-4458-8233-fa70efd8dd3c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:13.228061 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a7e129ba-99d7-4458-8233-fa70efd8dd3c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:13.236079 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a7e129ba-99d7-4458-8233-fa70efd8dd3c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969" status: 200 len: 1266 microversion: 2.1 time: 0.152394 Jun 27 18:56:13.236654 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 541/1066] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:13 2022] GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:13.612593 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-601150a1-a98e-438e-8701-b06f12607de8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:13.613195 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-601150a1-a98e-438e-8701-b06f12607de8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:13.619791 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-601150a1-a98e-438e-8701-b06f12607de8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:13.620277 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-601150a1-a98e-438e-8701-b06f12607de8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:13.621041 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-601150a1-a98e-438e-8701-b06f12607de8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:13.621475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-601150a1-a98e-438e-8701-b06f12607de8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:13.754275 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-601150a1-a98e-438e-8701-b06f12607de8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:13.770643 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-601150a1-a98e-438e-8701-b06f12607de8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944" status: 200 len: 1364 microversion: 2.1 time: 0.153822 Jun 27 18:56:13.770643 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 526/1067] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:13 2022] GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:14.253691 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-6a199a31-9e5f-4f2a-8195-d2f25a271d88 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:14.254309 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-6a199a31-9e5f-4f2a-8195-d2f25a271d88 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 16771a29-9fe8-4864-968e-645bc86cc969] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:14.261376 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6a199a31-9e5f-4f2a-8195-d2f25a271d88 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:14.261821 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6a199a31-9e5f-4f2a-8195-d2f25a271d88 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:14.262600 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6a199a31-9e5f-4f2a-8195-d2f25a271d88 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:14.263036 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-6a199a31-9e5f-4f2a-8195-d2f25a271d88 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:14.391726 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-6a199a31-9e5f-4f2a-8195-d2f25a271d88 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:14.399224 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-6a199a31-9e5f-4f2a-8195-d2f25a271d88 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969" status: 200 len: 1266 microversion: 2.1 time: 0.149859 Jun 27 18:56:14.399796 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 542/1068] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:14 2022] GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:14.780021 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a497588f-c485-4659-ba37-d4703e3fbd88 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:14.780653 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-a497588f-c485-4659-ba37-d4703e3fbd88 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:14.787365 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a497588f-c485-4659-ba37-d4703e3fbd88 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:14.787826 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a497588f-c485-4659-ba37-d4703e3fbd88 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:14.788603 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a497588f-c485-4659-ba37-d4703e3fbd88 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:14.789045 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a497588f-c485-4659-ba37-d4703e3fbd88 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:14.917326 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a497588f-c485-4659-ba37-d4703e3fbd88 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:14.924831 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-a497588f-c485-4659-ba37-d4703e3fbd88 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944" status: 200 len: 1555 microversion: 2.1 time: 0.149831 Jun 27 18:56:14.925397 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 527/1069] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:14 2022] GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:14.941156 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-aeb8db6f-765c-4a8c-ac14-ec77a1566bb9 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:14.941688 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-aeb8db6f-765c-4a8c-ac14-ec77a1566bb9 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:14.947577 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-aeb8db6f-765c-4a8c-ac14-ec77a1566bb9 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:14.948022 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-aeb8db6f-765c-4a8c-ac14-ec77a1566bb9 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:14.948774 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-aeb8db6f-765c-4a8c-ac14-ec77a1566bb9 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:14.949208 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-aeb8db6f-765c-4a8c-ac14-ec77a1566bb9 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:15.030542 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-aeb8db6f-765c-4a8c-ac14-ec77a1566bb9 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093326 Jun 27 18:56:15.031171 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 543/1070] 10.222.0.15 () {58 vars in 1274 bytes} [Mon Jun 27 18:56:14 2022] GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:56:15.417077 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-b0d53d15-3b6d-4677-9d26-b4882d5024c2 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:15.417724 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-b0d53d15-3b6d-4677-9d26-b4882d5024c2 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 16771a29-9fe8-4864-968e-645bc86cc969] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:15.423848 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b0d53d15-3b6d-4677-9d26-b4882d5024c2 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:15.424303 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b0d53d15-3b6d-4677-9d26-b4882d5024c2 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:15.425065 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b0d53d15-3b6d-4677-9d26-b4882d5024c2 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:15.425508 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-b0d53d15-3b6d-4677-9d26-b4882d5024c2 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:15.591679 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-b0d53d15-3b6d-4677-9d26-b4882d5024c2 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:15.599105 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-b0d53d15-3b6d-4677-9d26-b4882d5024c2 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969" status: 200 len: 1266 microversion: 2.1 time: 0.186050 Jun 27 18:56:15.599676 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 528/1071] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:15 2022] GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:16.330306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-9ffc5535-59c1-462a-9a27-971b0a8a7b82 req-5e3cb117-a12c-4bb4-b86f-68d7254f0c79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "538c87a8-e075-4a53-8b4c-11b8dd7db944", "tag": "c9eb5679-413d-47ff-a674-aa77c9e8ef04"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:56:16.339103 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-9ffc5535-59c1-462a-9a27-971b0a8a7b82 req-5e3cb117-a12c-4bb4-b86f-68d7254f0c79 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:16.339303 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-9ffc5535-59c1-462a-9a27-971b0a8a7b82 req-5e3cb117-a12c-4bb4-b86f-68d7254f0c79 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:16.350256 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-9ffc5535-59c1-462a-9a27-971b0a8a7b82 req-5e3cb117-a12c-4bb4-b86f-68d7254f0c79 service nova] Creating event network-changed:c9eb5679-413d-47ff-a674-aa77c9e8ef04 for instance 538c87a8-e075-4a53-8b4c-11b8dd7db944 on hv-cinder-84460 Jun 27 18:56:16.356120 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-9ffc5535-59c1-462a-9a27-971b0a8a7b82 req-5e3cb117-a12c-4bb4-b86f-68d7254f0c79 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084828 Jun 27 18:56:16.356795 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 544/1072] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:56:16.617188 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-da32dfad-57df-4fe9-b097-09a820ba4438 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:16.618474 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-da32dfad-57df-4fe9-b097-09a820ba4438 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 16771a29-9fe8-4864-968e-645bc86cc969] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:16.621620 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:16.627250 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-da32dfad-57df-4fe9-b097-09a820ba4438 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:16.627700 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-da32dfad-57df-4fe9-b097-09a820ba4438 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:16.628503 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-da32dfad-57df-4fe9-b097-09a820ba4438 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:16.629249 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-da32dfad-57df-4fe9-b097-09a820ba4438 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:16.783015 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-da32dfad-57df-4fe9-b097-09a820ba4438 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:16.790877 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-da32dfad-57df-4fe9-b097-09a820ba4438 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969" status: 200 len: 1266 microversion: 2.1 time: 0.177850 Jun 27 18:56:16.795140 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 529/1073] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:16 2022] GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:17.808800 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-94249608-a876-4461-aa1f-6ac98d795a88 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:17.809503 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-94249608-a876-4461-aa1f-6ac98d795a88 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 16771a29-9fe8-4864-968e-645bc86cc969] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:17.811499 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=4 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:17.812205 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=14 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:17.817827 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-94249608-a876-4461-aa1f-6ac98d795a88 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:17.829774 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-94249608-a876-4461-aa1f-6ac98d795a88 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:17.829774 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-94249608-a876-4461-aa1f-6ac98d795a88 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:17.829774 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-94249608-a876-4461-aa1f-6ac98d795a88 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:17.954597 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-94249608-a876-4461-aa1f-6ac98d795a88 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:17.962056 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-94249608-a876-4461-aa1f-6ac98d795a88 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969" status: 200 len: 1266 microversion: 2.1 time: 0.158195 Jun 27 18:56:17.962653 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 545/1074] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:17 2022] GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:18.979691 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-2ede6191-87a3-4db2-8f67-8e5a0754eef6 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:18.980306 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-2ede6191-87a3-4db2-8f67-8e5a0754eef6 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 16771a29-9fe8-4864-968e-645bc86cc969] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:18.982170 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell0:SELECT=8 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:18.987463 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2ede6191-87a3-4db2-8f67-8e5a0754eef6 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:18.987916 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2ede6191-87a3-4db2-8f67-8e5a0754eef6 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:18.988675 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2ede6191-87a3-4db2-8f67-8e5a0754eef6 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:18.989107 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2ede6191-87a3-4db2-8f67-8e5a0754eef6 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:19.125539 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-2ede6191-87a3-4db2-8f67-8e5a0754eef6 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:19.133079 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-2ede6191-87a3-4db2-8f67-8e5a0754eef6 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969" status: 200 len: 1266 microversion: 2.1 time: 0.158060 Jun 27 18:56:19.133668 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 530/1075] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:18 2022] GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:20.149466 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-db3fdc56-edbe-41b2-82c4-94fe42c31349 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:20.150082 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-db3fdc56-edbe-41b2-82c4-94fe42c31349 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 16771a29-9fe8-4864-968e-645bc86cc969] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:20.156886 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-db3fdc56-edbe-41b2-82c4-94fe42c31349 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:20.157341 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-db3fdc56-edbe-41b2-82c4-94fe42c31349 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:20.158136 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-db3fdc56-edbe-41b2-82c4-94fe42c31349 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:20.158605 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-db3fdc56-edbe-41b2-82c4-94fe42c31349 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:20.293106 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-db3fdc56-edbe-41b2-82c4-94fe42c31349 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:20.300712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-db3fdc56-edbe-41b2-82c4-94fe42c31349 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969" status: 200 len: 1266 microversion: 2.1 time: 0.155130 Jun 27 18:56:20.301286 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 546/1076] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:20 2022] GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:21.318314 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-93d5611d-a8e4-4c6f-9bff-066526a000c5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:21.319904 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-93d5611d-a8e4-4c6f-9bff-066526a000c5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 16771a29-9fe8-4864-968e-645bc86cc969] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:21.326245 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-93d5611d-a8e4-4c6f-9bff-066526a000c5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:21.326723 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-93d5611d-a8e4-4c6f-9bff-066526a000c5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:21.327506 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-93d5611d-a8e4-4c6f-9bff-066526a000c5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:21.327940 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-93d5611d-a8e4-4c6f-9bff-066526a000c5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:21.460269 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-93d5611d-a8e4-4c6f-9bff-066526a000c5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:21.468664 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-93d5611d-a8e4-4c6f-9bff-066526a000c5 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969" status: 200 len: 1266 microversion: 2.1 time: 0.154212 Jun 27 18:56:21.469237 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 531/1077] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:21 2022] GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:21.934492 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-d09dfd9e-1520-4a4f-a34e-4e8e44adb45f req-cb38bfbe-a1a6-476d-9453-cf2be18792ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16771a29-9fe8-4864-968e-645bc86cc969", "name": "network-vif-plugged", "status": "completed", "tag": "73b7ba71-0c22-43f7-a800-e4ea470160f2"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:56:21.943044 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-d09dfd9e-1520-4a4f-a34e-4e8e44adb45f req-cb38bfbe-a1a6-476d-9453-cf2be18792ed service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:21.943485 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-d09dfd9e-1520-4a4f-a34e-4e8e44adb45f req-cb38bfbe-a1a6-476d-9453-cf2be18792ed service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:21.954595 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-d09dfd9e-1520-4a4f-a34e-4e8e44adb45f req-cb38bfbe-a1a6-476d-9453-cf2be18792ed service nova] Creating event network-vif-plugged:73b7ba71-0c22-43f7-a800-e4ea470160f2 for instance 16771a29-9fe8-4864-968e-645bc86cc969 on hv-cinder-84460 Jun 27 18:56:21.959344 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-d09dfd9e-1520-4a4f-a34e-4e8e44adb45f req-cb38bfbe-a1a6-476d-9453-cf2be18792ed service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029578 Jun 27 18:56:21.959904 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 547/1078] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:56:22.486408 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-c9ecc8d3-82f5-4877-ab94-a92ab91fba00 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:22.487035 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-c9ecc8d3-82f5-4877-ab94-a92ab91fba00 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 16771a29-9fe8-4864-968e-645bc86cc969] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:22.493932 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c9ecc8d3-82f5-4877-ab94-a92ab91fba00 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:22.494412 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c9ecc8d3-82f5-4877-ab94-a92ab91fba00 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:22.495188 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c9ecc8d3-82f5-4877-ab94-a92ab91fba00 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:22.495665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-c9ecc8d3-82f5-4877-ab94-a92ab91fba00 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:22.626624 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-c9ecc8d3-82f5-4877-ab94-a92ab91fba00 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:22.634156 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-c9ecc8d3-82f5-4877-ab94-a92ab91fba00 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969" status: 200 len: 1266 microversion: 2.1 time: 0.151744 Jun 27 18:56:22.634756 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 532/1079] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:22 2022] GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:23.653550 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-7ce0876e-ffae-4fa9-9af5-720351eb4320 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:23.654309 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-7ce0876e-ffae-4fa9-9af5-720351eb4320 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 16771a29-9fe8-4864-968e-645bc86cc969] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:23.657302 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:23.660888 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7ce0876e-ffae-4fa9-9af5-720351eb4320 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:23.661340 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7ce0876e-ffae-4fa9-9af5-720351eb4320 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:23.662116 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7ce0876e-ffae-4fa9-9af5-720351eb4320 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:23.662569 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-7ce0876e-ffae-4fa9-9af5-720351eb4320 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:23.804478 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-7ce0876e-ffae-4fa9-9af5-720351eb4320 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:23.812002 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-7ce0876e-ffae-4fa9-9af5-720351eb4320 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969" status: 200 len: 1266 microversion: 2.1 time: 0.163469 Jun 27 18:56:23.812579 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 548/1080] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:23 2022] GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:24.829234 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a0d4d8b3-ca24-4175-8022-142725fe63ea tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:24.829860 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-a0d4d8b3-ca24-4175-8022-142725fe63ea tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 16771a29-9fe8-4864-968e-645bc86cc969] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:24.836412 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a0d4d8b3-ca24-4175-8022-142725fe63ea tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:24.836902 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a0d4d8b3-ca24-4175-8022-142725fe63ea tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:24.837675 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a0d4d8b3-ca24-4175-8022-142725fe63ea tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:24.838120 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a0d4d8b3-ca24-4175-8022-142725fe63ea tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:24.966807 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-a0d4d8b3-ca24-4175-8022-142725fe63ea tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:24.974288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-a0d4d8b3-ca24-4175-8022-142725fe63ea tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969" status: 200 len: 1453 microversion: 2.1 time: 0.149566 Jun 27 18:56:24.974889 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 533/1081] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:24 2022] GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:24.991420 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-06bc1aa1-cb29-4d8f-afa8-eec829420046 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:24.992040 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-06bc1aa1-cb29-4d8f-afa8-eec829420046 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 16771a29-9fe8-4864-968e-645bc86cc969] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:24.999683 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-06bc1aa1-cb29-4d8f-afa8-eec829420046 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:25.000076 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-06bc1aa1-cb29-4d8f-afa8-eec829420046 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:25.000838 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-06bc1aa1-cb29-4d8f-afa8-eec829420046 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:25.001274 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-06bc1aa1-cb29-4d8f-afa8-eec829420046 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:25.135040 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-06bc1aa1-cb29-4d8f-afa8-eec829420046 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:56:25.142900 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-06bc1aa1-cb29-4d8f-afa8-eec829420046 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969" status: 200 len: 1453 microversion: 2.1 time: 0.155681 Jun 27 18:56:25.143461 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 549/1082] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:56:24 2022] GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:56:27.054960 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-0de45ddc-fcf2-4a7b-821f-fea569877017 req-b574d8bc-36d2-478f-92b7-fcd9cae40cad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16771a29-9fe8-4864-968e-645bc86cc969", "tag": "73b7ba71-0c22-43f7-a800-e4ea470160f2"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:56:27.063787 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-0de45ddc-fcf2-4a7b-821f-fea569877017 req-b574d8bc-36d2-478f-92b7-fcd9cae40cad service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:27.064167 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-0de45ddc-fcf2-4a7b-821f-fea569877017 req-b574d8bc-36d2-478f-92b7-fcd9cae40cad service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:27.075224 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-0de45ddc-fcf2-4a7b-821f-fea569877017 req-b574d8bc-36d2-478f-92b7-fcd9cae40cad service nova] Creating event network-changed:73b7ba71-0c22-43f7-a800-e4ea470160f2 for instance 16771a29-9fe8-4864-968e-645bc86cc969 on hv-cinder-84460 Jun 27 18:56:27.080688 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-0de45ddc-fcf2-4a7b-821f-fea569877017 req-b574d8bc-36d2-478f-92b7-fcd9cae40cad service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029626 Jun 27 18:56:27.081287 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 534/1083] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:56:48.733283 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-358312b7-53a9-4d84-91e0-c36a197fd07d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:48.733904 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-358312b7-53a9-4d84-91e0-c36a197fd07d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:48.735789 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_api:SELECT=2 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:48.736436 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=45 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:48.741169 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-358312b7-53a9-4d84-91e0-c36a197fd07d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:48.741612 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-358312b7-53a9-4d84-91e0-c36a197fd07d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:48.742376 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-358312b7-53a9-4d84-91e0-c36a197fd07d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:48.742843 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-358312b7-53a9-4d84-91e0-c36a197fd07d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:48.767566 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-358312b7-53a9-4d84-91e0-c36a197fd07d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944/ips" status: 200 len: 151 microversion: 2.1 time: 0.038708 Jun 27 18:56:48.768149 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 550/1084] 10.222.0.15 () {58 vars in 1247 bytes} [Mon Jun 27 18:56:48 2022] GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:56:50.383087 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_api:SELECT=11 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:50.383830 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=58 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:50.387983 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-401aaa2b-65ed-4b65-b099-1262f50a06b4 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd2d7f23-5613-4cfa-9a46-6d51cc64ac55"}} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:56:50.389993 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-401aaa2b-65ed-4b65-b099-1262f50a06b4 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:50.396163 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-401aaa2b-65ed-4b65-b099-1262f50a06b4 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:50.396606 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-401aaa2b-65ed-4b65-b099-1262f50a06b4 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:50.397362 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-401aaa2b-65ed-4b65-b099-1262f50a06b4 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:50.397799 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-401aaa2b-65ed-4b65-b099-1262f50a06b4 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:51.111296 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-401aaa2b-65ed-4b65-b099-1262f50a06b4 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "POST /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.729286 Jun 27 18:56:51.113032 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 535/1085] 10.222.0.15 () {60 vars in 1322 bytes} [Mon Jun 27 18:56:50 2022] POST /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944/os-volume_attachments => generated 194 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:56:58.684658 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-d6e91f73-ab83-4852-9ec0-5e00089430b3 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:58.685169 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-d6e91f73-ab83-4852-9ec0-5e00089430b3 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:58.693549 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d6e91f73-ab83-4852-9ec0-5e00089430b3 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:58.693990 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d6e91f73-ab83-4852-9ec0-5e00089430b3 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:58.694771 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d6e91f73-ab83-4852-9ec0-5e00089430b3 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:58.695203 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d6e91f73-ab83-4852-9ec0-5e00089430b3 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:58.777310 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.objects.instance [None req-d6e91f73-ab83-4852-9ec0-5e00089430b3 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lazy-loading 'services' on Instance uuid 538c87a8-e075-4a53-8b4c-11b8dd7db944 {{(pid=124716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 18:56:58.985819 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-d6e91f73-ab83-4852-9ec0-5e00089430b3 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "DELETE /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944/os-volume_attachments/fd2d7f23-5613-4cfa-9a46-6d51cc64ac55" status: 202 len: 0 microversion: 2.1 time: 0.304910 Jun 27 18:56:58.986505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 551/1086] 10.222.0.15 () {58 vars in 1415 bytes} [Mon Jun 27 18:56:58 2022] DELETE /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944/os-volume_attachments/fd2d7f23-5613-4cfa-9a46-6d51cc64ac55 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:56:58.996720 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-a6b21222-fb57-446c-a693-d2d145697c3a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:56:58.997869 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-a6b21222-fb57-446c-a693-d2d145697c3a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:56:59.004617 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a6b21222-fb57-446c-a693-d2d145697c3a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:59.004987 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a6b21222-fb57-446c-a693-d2d145697c3a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:59.005748 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a6b21222-fb57-446c-a693-d2d145697c3a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:56:59.006312 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-a6b21222-fb57-446c-a693-d2d145697c3a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:56:59.035538 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-a6b21222-fb57-446c-a693-d2d145697c3a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043909 Jun 27 18:56:59.036071 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 536/1087] 10.222.0.15 () {58 vars in 1301 bytes} [Mon Jun 27 18:56:58 2022] GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:57:00.048661 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-d696110c-05d2-4148-92c0-35358b32591c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:57:00.049706 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-d696110c-05d2-4148-92c0-35358b32591c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:57:00.056441 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d696110c-05d2-4148-92c0-35358b32591c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:00.056888 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d696110c-05d2-4148-92c0-35358b32591c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:00.057641 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d696110c-05d2-4148-92c0-35358b32591c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:00.058075 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-d696110c-05d2-4148-92c0-35358b32591c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:00.086885 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-d696110c-05d2-4148-92c0-35358b32591c tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043611 Jun 27 18:57:00.087438 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 552/1088] 10.222.0.15 () {58 vars in 1301 bytes} [Mon Jun 27 18:57:00 2022] GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 18:57:00.144540 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-8cb67bee-b4c4-487b-93dd-c5c9c803106b tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:57:00.145049 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-8cb67bee-b4c4-487b-93dd-c5c9c803106b tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:57:00.151419 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8cb67bee-b4c4-487b-93dd-c5c9c803106b tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:00.151879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8cb67bee-b4c4-487b-93dd-c5c9c803106b tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:00.152647 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8cb67bee-b4c4-487b-93dd-c5c9c803106b tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:00.153091 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-8cb67bee-b4c4-487b-93dd-c5c9c803106b tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:00.181646 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-8cb67bee-b4c4-487b-93dd-c5c9c803106b tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Going to try to terminate instance {{(pid=124717) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 18:57:00.446510 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-8cb67bee-b4c4-487b-93dd-c5c9c803106b tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "DELETE /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944" status: 204 len: 0 microversion: 2.1 time: 0.305459 Jun 27 18:57:00.447022 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 537/1089] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:57:00 2022] DELETE /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 18:57:00.455812 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a9a494c7-e365-4da9-9f6a-bd7855efb202 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:57:00.456420 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a9a494c7-e365-4da9-9f6a-bd7855efb202 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:57:00.462273 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a9a494c7-e365-4da9-9f6a-bd7855efb202 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:00.462758 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a9a494c7-e365-4da9-9f6a-bd7855efb202 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:00.463539 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a9a494c7-e365-4da9-9f6a-bd7855efb202 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:00.463973 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a9a494c7-e365-4da9-9f6a-bd7855efb202 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:00.604271 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a9a494c7-e365-4da9-9f6a-bd7855efb202 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:57:00.612433 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a9a494c7-e365-4da9-9f6a-bd7855efb202 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944" status: 200 len: 1680 microversion: 2.1 time: 0.161172 Jun 27 18:57:00.613033 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 553/1090] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:57:00 2022] GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:57:01.630369 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-53cf0475-ff7c-4fc0-bcc4-f022fe2563fd tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:57:01.631126 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-53cf0475-ff7c-4fc0-bcc4-f022fe2563fd tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:57:01.637545 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-53cf0475-ff7c-4fc0-bcc4-f022fe2563fd tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:01.637995 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-53cf0475-ff7c-4fc0-bcc4-f022fe2563fd tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:01.638791 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-53cf0475-ff7c-4fc0-bcc4-f022fe2563fd tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:01.639233 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-53cf0475-ff7c-4fc0-bcc4-f022fe2563fd tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:01.773202 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-53cf0475-ff7c-4fc0-bcc4-f022fe2563fd tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:57:01.780559 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-53cf0475-ff7c-4fc0-bcc4-f022fe2563fd tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944" status: 200 len: 1680 microversion: 2.1 time: 0.154637 Jun 27 18:57:01.781152 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 538/1091] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:57:01 2022] GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:57:02.798886 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-c2e4d34d-4e55-48de-bc31-bd822ea39f0d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:57:02.800349 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-c2e4d34d-4e55-48de-bc31-bd822ea39f0d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:57:02.808875 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c2e4d34d-4e55-48de-bc31-bd822ea39f0d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:02.808875 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c2e4d34d-4e55-48de-bc31-bd822ea39f0d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:02.809727 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c2e4d34d-4e55-48de-bc31-bd822ea39f0d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:02.810255 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c2e4d34d-4e55-48de-bc31-bd822ea39f0d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:02.858752 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-df04c3ab-be07-4dca-a483-31d9a5b51ec6 req-a1151117-3569-45e3-8137-e0019e246f7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "538c87a8-e075-4a53-8b4c-11b8dd7db944", "name": "network-vif-deleted", "tag": "c9eb5679-413d-47ff-a674-aa77c9e8ef04"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:57:02.868079 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-df04c3ab-be07-4dca-a483-31d9a5b51ec6 req-a1151117-3569-45e3-8137-e0019e246f7e service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:02.868590 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-df04c3ab-be07-4dca-a483-31d9a5b51ec6 req-a1151117-3569-45e3-8137-e0019e246f7e service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:02.876311 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c2e4d34d-4e55-48de-bc31-bd822ea39f0d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac761d30de4fb49478a78ccf23ab92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a981ae734b1e4993bb440918b1a74fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:57:02.880279 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-df04c3ab-be07-4dca-a483-31d9a5b51ec6 req-a1151117-3569-45e3-8137-e0019e246f7e service nova] Creating event network-vif-deleted:c9eb5679-413d-47ff-a674-aa77c9e8ef04 for instance 538c87a8-e075-4a53-8b4c-11b8dd7db944 on hv-cinder-84460 Jun 27 18:57:02.885608 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-c2e4d34d-4e55-48de-bc31-bd822ea39f0d tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944" status: 200 len: 1614 microversion: 2.1 time: 0.091434 Jun 27 18:57:02.886537 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 554/1092] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:57:02 2022] GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944 => generated 1614 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:57:02.899387 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Traceback (most recent call last): Jun 27 18:57:02.904755 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 27 18:57:02.904755 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: timer() Jun 27 18:57:02.904755 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 27 18:57:02.904755 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: cb(*args, **kw) Jun 27 18:57:02.904755 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Jun 27 18:57:02.904755 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: waiter.switch() Jun 27 18:57:02.904755 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: greenlet.error: cannot switch to a different thread Jun 27 18:57:02.904755 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-df04c3ab-be07-4dca-a483-31d9a5b51ec6 req-a1151117-3569-45e3-8137-e0019e246f7e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046280 Jun 27 18:57:02.904755 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 539/1093] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:57:03.903429 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-c266cca6-27ec-41b7-939a-afbdddecf628 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:57:03.904053 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-c266cca6-27ec-41b7-939a-afbdddecf628 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:57:03.910879 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c266cca6-27ec-41b7-939a-afbdddecf628 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:03.911327 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c266cca6-27ec-41b7-939a-afbdddecf628 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:03.912083 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c266cca6-27ec-41b7-939a-afbdddecf628 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:03.912517 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c266cca6-27ec-41b7-939a-afbdddecf628 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:03.927244 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-c266cca6-27ec-41b7-939a-afbdddecf628 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] HTTP exception thrown: Instance 538c87a8-e075-4a53-8b4c-11b8dd7db944 could not be found. Jun 27 18:57:03.928911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-c266cca6-27ec-41b7-939a-afbdddecf628 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Request method failure captured: Jun 27 18:57:03.928911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944 HTTP/1.1 Jun 27 18:57:03.928911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:57:03.928911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:57:03.928911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:57:03.928911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:57:03.928911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:57:03.928911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:57:03.928911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:57:03.928911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:57:03.928911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufxujj71f0JcK6xynWFlkvJylD3VaW76hhLj6aYJdaIU72emt5fWMZbhrMQMXmzSnlN7izfTbQz8DDDms1aAEVEIobTTP_Qgn0UA0fG5dAYGKFUUdOXMjzqUBw4nwaAUQKw-YAQrfZf2wWTIXVqD3NfGLb3EDQz_tkmxCaoeCzMl1tQ Jun 27 18:57:03.928911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:57:03.928911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:57:03.928911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:57:03.928911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:57:03.928911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:57:03.928911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:57:03.928911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:57:03.928911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:03.928911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:57:03.928911 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:57:03.930422 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:57:03.930422 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:03.930422 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:57:03.930422 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:03.930422 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:57:03.930422 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:57:03.930422 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:57:03.930422 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: 48ac761d30de4fb49478a78ccf23ab92 Jun 27 18:57:03.930422 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:57:03.930422 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: > Jun 27 18:57:03.930422 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Instance 538c87a8-e075-4a53-8b4c-11b8dd7db944 could not be found. Jun 27 18:57:03.930422 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': '538c87a8-e075-4a53-8b4c-11b8dd7db944'} Jun 27 18:57:03.932042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:57:03.932042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:03.932042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:57:03.932042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:57:03.932042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:57:03.932042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:57:03.932042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:57:03.932042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:57:03.932042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:57:03.932042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:57:03.932042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 538c87a8-e075-4a53-8b4c-11b8dd7db944 could not be found. Jun 27 18:57:03.932042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:03.932042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:57:03.932042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:03.932042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:03.932042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:57:03.932042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:57:03.932042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:57:03.932042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:57:03.932042 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:57:03.934753 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:57:03.934753 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:57:03.934753 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:57:03.934753 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:57:03.934753 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:57:03.934753 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:57:03.934753 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:57:03.934753 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 538c87a8-e075-4a53-8b4c-11b8dd7db944 could not be found. Jun 27 18:57:03.934753 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:03.934753 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:57:03.934753 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:03.934753 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:03.934753 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:57:03.934753 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:57:03.934753 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:57:03.934753 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:57:03.934753 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 538c87a8-e075-4a53-8b4c-11b8dd7db944 could not be found. Jun 27 18:57:03.934753 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:03.936682 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-c266cca6-27ec-41b7-939a-afbdddecf628 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Returning 404 to user: Instance 538c87a8-e075-4a53-8b4c-11b8dd7db944 could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:57:03.936682 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-c266cca6-27ec-41b7-939a-afbdddecf628 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944" status: 404 len: 111 microversion: 2.1 time: 0.030926 Jun 27 18:57:03.936682 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 555/1094] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:57:03 2022] GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:57:03.941180 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-488a7025-da3b-4e1f-b7e6-91565287fef2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '.version_select at 0x7f700fe5ca60>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:57:04.021245 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-488a7025-da3b-4e1f-b7e6-91565287fef2 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-970099115" status: 202 len: 0 microversion: 2.1 time: 0.085520 Jun 27 18:57:04.021858 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 540/1095] 10.222.0.15 () {58 vars in 1217 bytes} [Mon Jun 27 18:57:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-970099115 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 18:57:06.089210 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-06699aa2-52f7-4e06-ad1d-20b8684b928a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:57:06.089756 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-06699aa2-52f7-4e06-ad1d-20b8684b928a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:57:06.097057 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-06699aa2-52f7-4e06-ad1d-20b8684b928a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:06.099486 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-06699aa2-52f7-4e06-ad1d-20b8684b928a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:06.099486 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-06699aa2-52f7-4e06-ad1d-20b8684b928a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:06.099486 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-06699aa2-52f7-4e06-ad1d-20b8684b928a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:06.112089 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-06699aa2-52f7-4e06-ad1d-20b8684b928a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] HTTP exception thrown: Instance 538c87a8-e075-4a53-8b4c-11b8dd7db944 could not be found. Jun 27 18:57:06.113686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-06699aa2-52f7-4e06-ad1d-20b8684b928a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Request method failure captured: Jun 27 18:57:06.113686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: DELETE /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944 HTTP/1.1 Jun 27 18:57:06.113686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:57:06.113686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:57:06.113686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:57:06.113686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:57:06.113686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:57:06.113686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:57:06.113686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:57:06.113686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:57:06.113686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufxujj71f0JcK6xynWFlkvJylD3VaW76hhLj6aYJdaIU72emt5fWMZbhrMQMXmzSnlN7izfTbQz8DDDms1aAEVEIobTTP_Qgn0UA0fG5dAYGKFUUdOXMjzqUBw4nwaAUQKw-YAQrfZf2wWTIXVqD3NfGLb3EDQz_tkmxCaoeCzMl1tQ Jun 27 18:57:06.113686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:57:06.113686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:57:06.113686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:57:06.113686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:57:06.113686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:57:06.113686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:57:06.113686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:57:06.113686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:06.113686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:57:06.113686 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:57:06.117819 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:57:06.117819 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:06.117819 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:57:06.117819 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:06.117819 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:57:06.117819 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:57:06.117819 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:57:06.117819 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: 48ac761d30de4fb49478a78ccf23ab92 Jun 27 18:57:06.117819 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:57:06.117819 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: > Jun 27 18:57:06.117819 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Instance 538c87a8-e075-4a53-8b4c-11b8dd7db944 could not be found. Jun 27 18:57:06.117819 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': '538c87a8-e075-4a53-8b4c-11b8dd7db944'} Jun 27 18:57:06.118820 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:57:06.118820 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:06.118820 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:57:06.118820 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:57:06.118820 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:57:06.118820 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:57:06.118820 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:57:06.118820 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:57:06.118820 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:57:06.118820 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:57:06.118820 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 538c87a8-e075-4a53-8b4c-11b8dd7db944 could not be found. Jun 27 18:57:06.118820 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:06.118820 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:57:06.118820 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:06.118820 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:06.118820 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:57:06.118820 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:57:06.118820 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:57:06.118820 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:57:06.118820 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:57:06.120505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:57:06.120505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 18:57:06.120505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 18:57:06.120505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 18:57:06.120505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 18:57:06.120505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:57:06.120505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:57:06.120505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:57:06.120505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:57:06.120505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 538c87a8-e075-4a53-8b4c-11b8dd7db944 could not be found. Jun 27 18:57:06.120505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:06.120505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:57:06.120505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:06.120505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:06.120505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:57:06.120505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:57:06.120505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:57:06.120505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:57:06.120505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 538c87a8-e075-4a53-8b4c-11b8dd7db944 could not be found. Jun 27 18:57:06.120505 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:06.122092 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-06699aa2-52f7-4e06-ad1d-20b8684b928a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Returning 404 to user: Instance 538c87a8-e075-4a53-8b4c-11b8dd7db944 could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:57:06.122092 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-06699aa2-52f7-4e06-ad1d-20b8684b928a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "DELETE /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944" status: 404 len: 111 microversion: 2.1 time: 0.029834 Jun 27 18:57:06.122092 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 556/1096] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:57:06 2022] DELETE /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:57:06.125291 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-aaaef0cc-7528-4ede-ba15-38d80c7160b5 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:57:06.126095 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-aaaef0cc-7528-4ede-ba15-38d80c7160b5 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 538c87a8-e075-4a53-8b4c-11b8dd7db944] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:57:06.133382 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-aaaef0cc-7528-4ede-ba15-38d80c7160b5 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:06.133777 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-aaaef0cc-7528-4ede-ba15-38d80c7160b5 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:06.134581 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-aaaef0cc-7528-4ede-ba15-38d80c7160b5 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:06.135025 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-aaaef0cc-7528-4ede-ba15-38d80c7160b5 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:06.148578 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-aaaef0cc-7528-4ede-ba15-38d80c7160b5 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] HTTP exception thrown: Instance 538c87a8-e075-4a53-8b4c-11b8dd7db944 could not be found. Jun 27 18:57:06.151176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-aaaef0cc-7528-4ede-ba15-38d80c7160b5 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Request method failure captured: Jun 27 18:57:06.151176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944 HTTP/1.1 Jun 27 18:57:06.151176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 18:57:06.151176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 18:57:06.151176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 18:57:06.151176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 0 Jun 27 18:57:06.151176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 18:57:06.151176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 18:57:06.151176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 18:57:06.151176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 18:57:06.151176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufxujj71f0JcK6xynWFlkvJylD3VaW76hhLj6aYJdaIU72emt5fWMZbhrMQMXmzSnlN7izfTbQz8DDDms1aAEVEIobTTP_Qgn0UA0fG5dAYGKFUUdOXMjzqUBw4nwaAUQKw-YAQrfZf2wWTIXVqD3NfGLb3EDQz_tkmxCaoeCzMl1tQ Jun 27 18:57:06.151176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 18:57:06.151176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 18:57:06.151176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 18:57:06.151176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 18:57:06.151176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 18:57:06.151176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 18:57:06.151176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:57:06.151176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:06.151176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 18:57:06.151176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 18:57:06.152914 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:57:06.152914 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:06.152914 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:57:06.152914 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:06.152914 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:57:06.152914 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 18:57:06.152914 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 18:57:06.152914 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: 48ac761d30de4fb49478a78ccf23ab92 Jun 27 18:57:06.152914 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:57:06.152914 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: > Jun 27 18:57:06.152914 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Instance 538c87a8-e075-4a53-8b4c-11b8dd7db944 could not be found. Jun 27 18:57:06.152914 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'id': '538c87a8-e075-4a53-8b4c-11b8dd7db944'} Jun 27 18:57:06.153879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:57:06.153879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:06.153879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:57:06.153879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:57:06.153879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:57:06.153879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:57:06.153879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:57:06.153879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:57:06.153879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:57:06.153879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:57:06.153879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 538c87a8-e075-4a53-8b4c-11b8dd7db944 could not be found. Jun 27 18:57:06.153879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:57:06.153879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:57:06.153879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:57:06.153879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:06.153879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:57:06.153879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:57:06.153879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:57:06.153879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:57:06.153879 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:57:06.155455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:57:06.155455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:57:06.155455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:57:06.155455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:57:06.155455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:57:06.155455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:57:06.155455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:57:06.155455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 538c87a8-e075-4a53-8b4c-11b8dd7db944 could not be found. Jun 27 18:57:06.155455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:57:06.155455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:57:06.155455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:57:06.155455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:06.155455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:57:06.155455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:57:06.155455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:57:06.155455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:57:06.155455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 538c87a8-e075-4a53-8b4c-11b8dd7db944 could not be found. Jun 27 18:57:06.155455 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:57:06.157376 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-aaaef0cc-7528-4ede-ba15-38d80c7160b5 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Returning 404 to user: Instance 538c87a8-e075-4a53-8b4c-11b8dd7db944 could not be found. {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:57:06.157376 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-aaaef0cc-7528-4ede-ba15-38d80c7160b5 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944" status: 404 len: 111 microversion: 2.1 time: 0.031330 Jun 27 18:57:06.157376 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 541/1097] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:57:06 2022] GET /compute/v2.1/servers/538c87a8-e075-4a53-8b4c-11b8dd7db944 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 18:57:07.409044 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-b59d2210-ba84-4843-af95-b450aed12b7a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:57:07.409532 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-b59d2210-ba84-4843-af95-b450aed12b7a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:57:07.416271 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b59d2210-ba84-4843-af95-b450aed12b7a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:07.416716 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b59d2210-ba84-4843-af95-b450aed12b7a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:07.417469 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b59d2210-ba84-4843-af95-b450aed12b7a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:07.417901 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b59d2210-ba84-4843-af95-b450aed12b7a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:07.431600 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-b59d2210-ba84-4843-af95-b450aed12b7a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] HTTP exception thrown: Instance d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 could not be found. Jun 27 18:57:07.433154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-b59d2210-ba84-4843-af95-b450aed12b7a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Request method failure captured: Jun 27 18:57:07.433154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: DELETE /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 HTTP/1.1 Jun 27 18:57:07.433154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:57:07.433154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:57:07.433154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:57:07.433154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:57:07.433154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:57:07.433154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:57:07.433154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:57:07.433154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:57:07.433154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufxujj71f0JcK6xynWFlkvJylD3VaW76hhLj6aYJdaIU72emt5fWMZbhrMQMXmzSnlN7izfTbQz8DDDms1aAEVEIobTTP_Qgn0UA0fG5dAYGKFUUdOXMjzqUBw4nwaAUQKw-YAQrfZf2wWTIXVqD3NfGLb3EDQz_tkmxCaoeCzMl1tQ Jun 27 18:57:07.433154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:57:07.433154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:57:07.433154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:57:07.433154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:57:07.433154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:57:07.433154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:57:07.433154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:57:07.433154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:07.433154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:57:07.433154 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:57:07.434794 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:57:07.434794 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:07.434794 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:57:07.434794 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:07.434794 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:57:07.434794 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:57:07.434794 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:57:07.434794 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: 48ac761d30de4fb49478a78ccf23ab92 Jun 27 18:57:07.434794 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:57:07.434794 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: > Jun 27 18:57:07.434794 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Instance d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 could not be found. Jun 27 18:57:07.434794 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': 'd2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5'} Jun 27 18:57:07.435712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:57:07.435712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:07.435712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:57:07.435712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:57:07.435712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:57:07.435712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:57:07.435712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:57:07.435712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:57:07.435712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:57:07.435712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:57:07.435712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 could not be found. Jun 27 18:57:07.435712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:07.435712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:57:07.435712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:07.435712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:07.435712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:57:07.435712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:57:07.435712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:57:07.435712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:57:07.435712 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:57:07.437798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:57:07.437798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 18:57:07.437798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 18:57:07.437798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 18:57:07.437798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 18:57:07.437798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:57:07.437798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:57:07.437798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:57:07.437798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:57:07.437798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 could not be found. Jun 27 18:57:07.437798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:07.437798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:57:07.437798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:07.437798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:07.437798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:57:07.437798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:57:07.437798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:57:07.437798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:57:07.437798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 could not be found. Jun 27 18:57:07.437798 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:07.439313 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-b59d2210-ba84-4843-af95-b450aed12b7a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Returning 404 to user: Instance d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:57:07.439313 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-b59d2210-ba84-4843-af95-b450aed12b7a tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5" status: 404 len: 111 microversion: 2.1 time: 0.029780 Jun 27 18:57:07.439313 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 557/1098] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:57:07 2022] DELETE /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:57:07.444362 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-29b43446-44e2-4ecb-821d-0c651462a54f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:57:07.444992 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-29b43446-44e2-4ecb-821d-0c651462a54f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:57:07.451401 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-29b43446-44e2-4ecb-821d-0c651462a54f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:07.451856 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-29b43446-44e2-4ecb-821d-0c651462a54f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:07.452657 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-29b43446-44e2-4ecb-821d-0c651462a54f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:07.453933 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-29b43446-44e2-4ecb-821d-0c651462a54f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:07.466847 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-29b43446-44e2-4ecb-821d-0c651462a54f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] HTTP exception thrown: Instance d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 could not be found. Jun 27 18:57:07.468356 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-29b43446-44e2-4ecb-821d-0c651462a54f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Request method failure captured: Jun 27 18:57:07.468356 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 HTTP/1.1 Jun 27 18:57:07.468356 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 18:57:07.468356 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 18:57:07.468356 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 18:57:07.468356 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 0 Jun 27 18:57:07.468356 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 18:57:07.468356 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 18:57:07.468356 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 18:57:07.468356 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 18:57:07.468356 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufxujj71f0JcK6xynWFlkvJylD3VaW76hhLj6aYJdaIU72emt5fWMZbhrMQMXmzSnlN7izfTbQz8DDDms1aAEVEIobTTP_Qgn0UA0fG5dAYGKFUUdOXMjzqUBw4nwaAUQKw-YAQrfZf2wWTIXVqD3NfGLb3EDQz_tkmxCaoeCzMl1tQ Jun 27 18:57:07.468356 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 18:57:07.468356 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 18:57:07.468356 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 18:57:07.468356 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 18:57:07.468356 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 18:57:07.468356 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 18:57:07.468356 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:57:07.468356 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:07.468356 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 18:57:07.468356 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 18:57:07.470144 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:57:07.470144 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:07.470144 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:57:07.470144 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:07.470144 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:57:07.470144 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 18:57:07.470144 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 18:57:07.470144 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: 48ac761d30de4fb49478a78ccf23ab92 Jun 27 18:57:07.470144 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:57:07.470144 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: > Jun 27 18:57:07.470144 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Instance d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 could not be found. Jun 27 18:57:07.470144 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'id': 'd2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5'} Jun 27 18:57:07.471085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:57:07.471085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:07.471085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:57:07.471085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:57:07.471085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:57:07.471085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:57:07.471085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:57:07.471085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:57:07.471085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:57:07.471085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:57:07.471085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 could not be found. Jun 27 18:57:07.471085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:57:07.471085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:57:07.471085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:57:07.471085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:07.471085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:57:07.471085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:57:07.471085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:57:07.471085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:57:07.471085 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:57:07.472585 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:57:07.472585 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:57:07.472585 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:57:07.472585 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:57:07.472585 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:57:07.472585 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:57:07.472585 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:57:07.472585 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 could not be found. Jun 27 18:57:07.472585 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:57:07.472585 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:57:07.472585 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:57:07.472585 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:07.472585 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:57:07.472585 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:57:07.472585 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:57:07.472585 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:57:07.472585 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 could not be found. Jun 27 18:57:07.472585 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:57:07.473921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-29b43446-44e2-4ecb-821d-0c651462a54f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Returning 404 to user: Instance d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 could not be found. {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:57:07.473921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-29b43446-44e2-4ecb-821d-0c651462a54f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5" status: 404 len: 111 microversion: 2.1 time: 0.029586 Jun 27 18:57:07.473921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 542/1099] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:57:07 2022] GET /compute/v2.1/servers/d2414388-ddf4-4f56-b5dd-4cf2aaf2bbd5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:57:07.478597 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-9f856b11-a19c-4fa1-997d-da7522479a1f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:57:07.479099 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-9f856b11-a19c-4fa1-997d-da7522479a1f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:57:07.485662 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9f856b11-a19c-4fa1-997d-da7522479a1f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:07.486110 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9f856b11-a19c-4fa1-997d-da7522479a1f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:07.486898 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9f856b11-a19c-4fa1-997d-da7522479a1f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:07.487337 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-9f856b11-a19c-4fa1-997d-da7522479a1f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:07.501088 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-9f856b11-a19c-4fa1-997d-da7522479a1f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] HTTP exception thrown: Instance 0c49e97a-ae62-46cd-addc-ac3558e6feb2 could not be found. Jun 27 18:57:07.502651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-9f856b11-a19c-4fa1-997d-da7522479a1f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Request method failure captured: Jun 27 18:57:07.502651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: DELETE /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2 HTTP/1.1 Jun 27 18:57:07.502651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:57:07.502651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:57:07.502651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:57:07.502651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:57:07.502651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:57:07.502651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:57:07.502651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:57:07.502651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:57:07.502651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufxujj71f0JcK6xynWFlkvJylD3VaW76hhLj6aYJdaIU72emt5fWMZbhrMQMXmzSnlN7izfTbQz8DDDms1aAEVEIobTTP_Qgn0UA0fG5dAYGKFUUdOXMjzqUBw4nwaAUQKw-YAQrfZf2wWTIXVqD3NfGLb3EDQz_tkmxCaoeCzMl1tQ Jun 27 18:57:07.502651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:57:07.502651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:57:07.502651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:57:07.502651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:57:07.502651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:57:07.502651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:57:07.502651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:57:07.502651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:07.502651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:57:07.502651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:57:07.504266 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:57:07.504266 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:07.504266 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:57:07.504266 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:07.504266 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:57:07.504266 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:57:07.504266 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:57:07.504266 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: 48ac761d30de4fb49478a78ccf23ab92 Jun 27 18:57:07.504266 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:57:07.504266 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: > Jun 27 18:57:07.504266 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Instance 0c49e97a-ae62-46cd-addc-ac3558e6feb2 could not be found. Jun 27 18:57:07.504266 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': '0c49e97a-ae62-46cd-addc-ac3558e6feb2'} Jun 27 18:57:07.505121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:57:07.505121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:07.505121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:57:07.505121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:57:07.505121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:57:07.505121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:57:07.505121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:57:07.505121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:57:07.505121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:57:07.505121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:57:07.505121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c49e97a-ae62-46cd-addc-ac3558e6feb2 could not be found. Jun 27 18:57:07.505121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:07.505121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:57:07.505121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:07.505121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:07.505121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:57:07.505121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:57:07.505121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:57:07.505121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:57:07.505121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:57:07.506554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:57:07.506554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 18:57:07.506554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 18:57:07.506554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 18:57:07.506554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 18:57:07.506554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:57:07.506554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:57:07.506554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:57:07.506554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:57:07.506554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c49e97a-ae62-46cd-addc-ac3558e6feb2 could not be found. Jun 27 18:57:07.506554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:07.506554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:57:07.506554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:07.506554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:07.506554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:57:07.506554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:57:07.506554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:57:07.506554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:57:07.506554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c49e97a-ae62-46cd-addc-ac3558e6feb2 could not be found. Jun 27 18:57:07.506554 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:07.507852 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-9f856b11-a19c-4fa1-997d-da7522479a1f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Returning 404 to user: Instance 0c49e97a-ae62-46cd-addc-ac3558e6feb2 could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:57:07.507852 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-9f856b11-a19c-4fa1-997d-da7522479a1f tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2" status: 404 len: 111 microversion: 2.1 time: 0.029342 Jun 27 18:57:07.507852 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 558/1100] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:57:07 2022] DELETE /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 18:57:07.512362 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-2cfaa443-ab3f-4c19-a5d4-0b6a9dea3d04 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:57:07.512986 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-2cfaa443-ab3f-4c19-a5d4-0b6a9dea3d04 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: 0c49e97a-ae62-46cd-addc-ac3558e6feb2] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:57:07.519151 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2cfaa443-ab3f-4c19-a5d4-0b6a9dea3d04 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:07.519617 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2cfaa443-ab3f-4c19-a5d4-0b6a9dea3d04 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:07.520418 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2cfaa443-ab3f-4c19-a5d4-0b6a9dea3d04 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:07.520864 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-2cfaa443-ab3f-4c19-a5d4-0b6a9dea3d04 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:07.533853 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-2cfaa443-ab3f-4c19-a5d4-0b6a9dea3d04 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] HTTP exception thrown: Instance 0c49e97a-ae62-46cd-addc-ac3558e6feb2 could not be found. Jun 27 18:57:07.535393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-2cfaa443-ab3f-4c19-a5d4-0b6a9dea3d04 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Request method failure captured: Jun 27 18:57:07.535393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2 HTTP/1.1 Jun 27 18:57:07.535393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 18:57:07.535393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 18:57:07.535393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 18:57:07.535393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 0 Jun 27 18:57:07.535393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 18:57:07.535393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 18:57:07.535393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 18:57:07.535393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 18:57:07.535393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufxujj71f0JcK6xynWFlkvJylD3VaW76hhLj6aYJdaIU72emt5fWMZbhrMQMXmzSnlN7izfTbQz8DDDms1aAEVEIobTTP_Qgn0UA0fG5dAYGKFUUdOXMjzqUBw4nwaAUQKw-YAQrfZf2wWTIXVqD3NfGLb3EDQz_tkmxCaoeCzMl1tQ Jun 27 18:57:07.535393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 18:57:07.535393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 18:57:07.535393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 18:57:07.535393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 18:57:07.535393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 18:57:07.535393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 18:57:07.535393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:57:07.535393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:07.535393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 18:57:07.535393 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 18:57:07.537008 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:57:07.537008 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:07.537008 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:57:07.537008 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:07.537008 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:57:07.537008 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 18:57:07.537008 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 18:57:07.537008 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: 48ac761d30de4fb49478a78ccf23ab92 Jun 27 18:57:07.537008 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:57:07.537008 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: > Jun 27 18:57:07.537008 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Instance 0c49e97a-ae62-46cd-addc-ac3558e6feb2 could not be found. Jun 27 18:57:07.537008 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'id': '0c49e97a-ae62-46cd-addc-ac3558e6feb2'} Jun 27 18:57:07.537921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:57:07.537921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:07.537921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:57:07.537921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:57:07.537921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:57:07.537921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:57:07.537921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:57:07.537921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:57:07.537921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:57:07.537921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:57:07.537921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c49e97a-ae62-46cd-addc-ac3558e6feb2 could not be found. Jun 27 18:57:07.537921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:57:07.537921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:57:07.537921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:57:07.537921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:07.537921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:57:07.537921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:57:07.537921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:57:07.537921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:57:07.537921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:57:07.539430 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:57:07.539430 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:57:07.539430 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:57:07.539430 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:57:07.539430 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:57:07.539430 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:57:07.539430 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:57:07.539430 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c49e97a-ae62-46cd-addc-ac3558e6feb2 could not be found. Jun 27 18:57:07.539430 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:57:07.539430 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:57:07.539430 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:57:07.539430 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:07.539430 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:57:07.539430 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:57:07.539430 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:57:07.539430 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:57:07.539430 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c49e97a-ae62-46cd-addc-ac3558e6feb2 could not be found. Jun 27 18:57:07.539430 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:57:07.540822 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-2cfaa443-ab3f-4c19-a5d4-0b6a9dea3d04 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Returning 404 to user: Instance 0c49e97a-ae62-46cd-addc-ac3558e6feb2 could not be found. {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:57:07.540822 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-2cfaa443-ab3f-4c19-a5d4-0b6a9dea3d04 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2" status: 404 len: 111 microversion: 2.1 time: 0.028280 Jun 27 18:57:07.540822 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 543/1101] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:57:07 2022] GET /compute/v2.1/servers/0c49e97a-ae62-46cd-addc-ac3558e6feb2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:57:08.790619 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-acac89b5-a6e1-4d87-8491-98b03642cd61 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:57:08.791103 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-acac89b5-a6e1-4d87-8491-98b03642cd61 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:57:08.797821 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-acac89b5-a6e1-4d87-8491-98b03642cd61 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:08.798256 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-acac89b5-a6e1-4d87-8491-98b03642cd61 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:08.799049 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-acac89b5-a6e1-4d87-8491-98b03642cd61 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:08.799497 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-acac89b5-a6e1-4d87-8491-98b03642cd61 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:08.813264 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-acac89b5-a6e1-4d87-8491-98b03642cd61 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] HTTP exception thrown: Instance f070b8e2-2360-4dec-b274-cfa0a90a8a22 could not be found. Jun 27 18:57:08.814855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-acac89b5-a6e1-4d87-8491-98b03642cd61 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Request method failure captured: Jun 27 18:57:08.814855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: DELETE /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22 HTTP/1.1 Jun 27 18:57:08.814855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 18:57:08.814855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 18:57:08.814855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 18:57:08.814855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 18:57:08.814855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 18:57:08.814855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 18:57:08.814855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 18:57:08.814855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 18:57:08.814855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufxujj71f0JcK6xynWFlkvJylD3VaW76hhLj6aYJdaIU72emt5fWMZbhrMQMXmzSnlN7izfTbQz8DDDms1aAEVEIobTTP_Qgn0UA0fG5dAYGKFUUdOXMjzqUBw4nwaAUQKw-YAQrfZf2wWTIXVqD3NfGLb3EDQz_tkmxCaoeCzMl1tQ Jun 27 18:57:08.814855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 18:57:08.814855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 18:57:08.814855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 18:57:08.814855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 18:57:08.814855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 18:57:08.814855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 18:57:08.814855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:57:08.814855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:08.814855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 18:57:08.814855 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 18:57:08.816588 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:57:08.816588 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:08.816588 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:57:08.816588 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:08.816588 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:57:08.816588 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 18:57:08.816588 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 18:57:08.816588 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: 48ac761d30de4fb49478a78ccf23ab92 Jun 27 18:57:08.816588 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:57:08.816588 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: > Jun 27 18:57:08.816588 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Instance f070b8e2-2360-4dec-b274-cfa0a90a8a22 could not be found. Jun 27 18:57:08.816588 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': 'f070b8e2-2360-4dec-b274-cfa0a90a8a22'} Jun 27 18:57:08.817557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:57:08.817557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:08.817557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:57:08.817557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:57:08.817557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:57:08.817557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:57:08.817557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:57:08.817557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:57:08.817557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:57:08.817557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:57:08.817557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f070b8e2-2360-4dec-b274-cfa0a90a8a22 could not be found. Jun 27 18:57:08.817557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:08.817557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:57:08.817557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:08.817557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:08.817557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:57:08.817557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:57:08.817557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:57:08.817557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:57:08.817557 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:57:08.819125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:57:08.819125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 18:57:08.819125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 18:57:08.819125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 18:57:08.819125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 18:57:08.819125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:57:08.819125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:57:08.819125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:57:08.819125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:57:08.819125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f070b8e2-2360-4dec-b274-cfa0a90a8a22 could not be found. Jun 27 18:57:08.819125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:08.819125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:57:08.819125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:08.819125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:08.819125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:57:08.819125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:57:08.819125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:57:08.819125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:57:08.819125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f070b8e2-2360-4dec-b274-cfa0a90a8a22 could not be found. Jun 27 18:57:08.819125 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 18:57:08.820653 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-acac89b5-a6e1-4d87-8491-98b03642cd61 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Returning 404 to user: Instance f070b8e2-2360-4dec-b274-cfa0a90a8a22 could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:57:08.820653 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-acac89b5-a6e1-4d87-8491-98b03642cd61 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22" status: 404 len: 111 microversion: 2.1 time: 0.029562 Jun 27 18:57:08.820653 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 559/1102] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 18:57:08 2022] DELETE /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:57:08.825436 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-d3cecea1-68be-4d82-9fca-9b7f8ca7f8b8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:57:08.826061 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-d3cecea1-68be-4d82-9fca-9b7f8ca7f8b8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] [instance: f070b8e2-2360-4dec-b274-cfa0a90a8a22] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:57:08.833112 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d3cecea1-68be-4d82-9fca-9b7f8ca7f8b8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:08.833563 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d3cecea1-68be-4d82-9fca-9b7f8ca7f8b8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:08.834322 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d3cecea1-68be-4d82-9fca-9b7f8ca7f8b8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:57:08.834784 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d3cecea1-68be-4d82-9fca-9b7f8ca7f8b8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:57:08.847826 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-d3cecea1-68be-4d82-9fca-9b7f8ca7f8b8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] HTTP exception thrown: Instance f070b8e2-2360-4dec-b274-cfa0a90a8a22 could not be found. Jun 27 18:57:08.849343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-d3cecea1-68be-4d82-9fca-9b7f8ca7f8b8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Request method failure captured: Jun 27 18:57:08.849343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22 HTTP/1.1 Jun 27 18:57:08.849343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 18:57:08.849343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 18:57:08.849343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 18:57:08.849343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 0 Jun 27 18:57:08.849343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 18:57:08.849343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 18:57:08.849343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 18:57:08.849343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 18:57:08.849343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufxujj71f0JcK6xynWFlkvJylD3VaW76hhLj6aYJdaIU72emt5fWMZbhrMQMXmzSnlN7izfTbQz8DDDms1aAEVEIobTTP_Qgn0UA0fG5dAYGKFUUdOXMjzqUBw4nwaAUQKw-YAQrfZf2wWTIXVqD3NfGLb3EDQz_tkmxCaoeCzMl1tQ Jun 27 18:57:08.849343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 18:57:08.849343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 18:57:08.849343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 18:57:08.849343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 18:57:08.849343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 18:57:08.849343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 18:57:08.849343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:57:08.849343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:08.849343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 18:57:08.849343 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 18:57:08.850989 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a981ae734b1e4993bb440918b1a74fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 18:57:08.850989 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:08.850989 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: a981ae734b1e4993bb440918b1a74fe7 Jun 27 18:57:08.850989 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135072482 Jun 27 18:57:08.850989 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:57:08.850989 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 18:57:08.850989 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 18:57:08.850989 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: 48ac761d30de4fb49478a78ccf23ab92 Jun 27 18:57:08.850989 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-AttachVolumeNegativeTest-135072482-project Jun 27 18:57:08.850989 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: > Jun 27 18:57:08.850989 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Instance f070b8e2-2360-4dec-b274-cfa0a90a8a22 could not be found. Jun 27 18:57:08.850989 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'id': 'f070b8e2-2360-4dec-b274-cfa0a90a8a22'} Jun 27 18:57:08.851899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 18:57:08.851899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:08.851899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 18:57:08.851899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 18:57:08.851899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 18:57:08.851899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 18:57:08.851899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 18:57:08.851899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 18:57:08.851899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 18:57:08.851899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 18:57:08.851899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f070b8e2-2360-4dec-b274-cfa0a90a8a22 could not be found. Jun 27 18:57:08.851899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:57:08.851899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:57:08.851899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:57:08.851899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:08.851899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:57:08.851899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:57:08.851899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 18:57:08.851899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 18:57:08.851899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 18:57:08.853386 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 18:57:08.853386 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 18:57:08.853386 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 18:57:08.853386 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 18:57:08.853386 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 18:57:08.853386 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 18:57:08.853386 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 18:57:08.853386 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f070b8e2-2360-4dec-b274-cfa0a90a8a22 could not be found. Jun 27 18:57:08.853386 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:57:08.853386 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 18:57:08.853386 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:57:08.853386 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 18:57:08.853386 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 18:57:08.853386 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 18:57:08.853386 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 18:57:08.853386 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 18:57:08.853386 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f070b8e2-2360-4dec-b274-cfa0a90a8a22 could not be found. Jun 27 18:57:08.853386 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 18:57:08.854833 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-d3cecea1-68be-4d82-9fca-9b7f8ca7f8b8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] Returning 404 to user: Instance f070b8e2-2360-4dec-b274-cfa0a90a8a22 could not be found. {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 18:57:08.854833 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-d3cecea1-68be-4d82-9fca-9b7f8ca7f8b8 tempest-AttachVolumeNegativeTest-135072482 tempest-AttachVolumeNegativeTest-135072482-project] 10.222.0.15 "GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22" status: 404 len: 111 microversion: 2.1 time: 0.029272 Jun 27 18:57:08.854833 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 544/1103] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:57:08 2022] GET /compute/v2.1/servers/f070b8e2-2360-4dec-b274-cfa0a90a8a22 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 18:58:16.087519 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-2eb357ef-8ce6-4d9e-b460-25907c38626a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-751765850", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1210628940", "security_groups": [{"name": "tempest-secgroup-smoke-1765541639"}], "block_device_mapping_v2": [{"uuid": "23609552-ad3a-413c-9383-9cf29e474443", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "258993d8-d320-41d5-9b9f-c929b6912ace"}]}} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:58:16.097253 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_api:SELECT=20 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:16.097905 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:16.199184 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.network.neutron [None req-2eb357ef-8ce6-4d9e-b460-25907c38626a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] validate_networks() for [('258993d8-d320-41d5-9b9f-c929b6912ace', None, None, None, None, None)] {{(pid=124716) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 18:58:16.554660 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-2eb357ef-8ce6-4d9e-b460-25907c38626a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Flavor limits 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 18:58:16.555094 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-2eb357ef-8ce6-4d9e-b460-25907c38626a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Image limits 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 18:58:16.555573 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-2eb357ef-8ce6-4d9e-b460-25907c38626a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Flavor pref 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 18:58:16.555983 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-2eb357ef-8ce6-4d9e-b460-25907c38626a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Image pref 0:0:0 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 18:58:16.556399 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.virt.hardware [None req-2eb357ef-8ce6-4d9e-b460-25907c38626a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 18:58:16.566209 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2eb357ef-8ce6-4d9e-b460-25907c38626a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:16.566722 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2eb357ef-8ce6-4d9e-b460-25907c38626a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:16.567524 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2eb357ef-8ce6-4d9e-b460-25907c38626a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:16.567989 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-2eb357ef-8ce6-4d9e-b460-25907c38626a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:16.585442 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-2eb357ef-8ce6-4d9e-b460-25907c38626a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Getting quotas for project 302e8c5b4c1f422fbd5cf5602a094d2e. Resources: {'ram', 'cores', 'instances'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 18:58:16.589609 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.quota [None req-2eb357ef-8ce6-4d9e-b460-25907c38626a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Getting quotas for user b10a90cce1b048d7bd55938811301ab4 and project 302e8c5b4c1f422fbd5cf5602a094d2e. Resources: {'ram', 'cores', 'instances'} {{(pid=124716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 18:58:16.647436 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-2eb357ef-8ce6-4d9e-b460-25907c38626a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Going to run 1 instances... {{(pid=124716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 18:58:16.649649 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-2eb357ef-8ce6-4d9e-b460-25907c38626a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: dc46224b-17f7-473f-be38-fd61c04db9d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='23609552-ad3a-413c-9383-9cf29e474443',volume_size=None,volume_type=None)] {{(pid=124716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 18:58:17.055286 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-2eb357ef-8ce6-4d9e-b460-25907c38626a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.972483 Jun 27 18:58:17.055846 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 560/1104] 10.222.0.15 () {60 vars in 1146 bytes} [Mon Jun 27 18:58:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 18:58:17.064093 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:17.069078 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:17.069078 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-d6aa5e3b-3dbe-4db1-ad1e-ef76ce9e3fe0 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:58:17.072301 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-d6aa5e3b-3dbe-4db1-ad1e-ef76ce9e3fe0 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: dc46224b-17f7-473f-be38-fd61c04db9d7] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:58:17.136628 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-d6aa5e3b-3dbe-4db1-ad1e-ef76ce9e3fe0 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:58:17.147641 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-d6aa5e3b-3dbe-4db1-ad1e-ef76ce9e3fe0 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7" status: 200 len: 1094 microversion: 2.1 time: 0.085481 Jun 27 18:58:17.149682 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 545/1105] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:58:17 2022] GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7 => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:58:18.166723 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-09bc8563-27c0-4ad3-96d1-be558314c6c3 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:58:18.167351 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-09bc8563-27c0-4ad3-96d1-be558314c6c3 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: dc46224b-17f7-473f-be38-fd61c04db9d7] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:58:18.175761 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-09bc8563-27c0-4ad3-96d1-be558314c6c3 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:18.176215 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-09bc8563-27c0-4ad3-96d1-be558314c6c3 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:18.176987 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-09bc8563-27c0-4ad3-96d1-be558314c6c3 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:18.177426 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-09bc8563-27c0-4ad3-96d1-be558314c6c3 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:18.344380 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-09bc8563-27c0-4ad3-96d1-be558314c6c3 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:58:18.352117 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-09bc8563-27c0-4ad3-96d1-be558314c6c3 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7" status: 200 len: 1136 microversion: 2.1 time: 0.190020 Jun 27 18:58:18.352683 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 561/1106] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:58:18 2022] GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7 => generated 1136 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:58:19.369954 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-3787ce66-c792-4896-8b84-988922e78350 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:58:19.370680 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-3787ce66-c792-4896-8b84-988922e78350 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: dc46224b-17f7-473f-be38-fd61c04db9d7] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:58:19.379935 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3787ce66-c792-4896-8b84-988922e78350 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:19.381742 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3787ce66-c792-4896-8b84-988922e78350 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:19.381742 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3787ce66-c792-4896-8b84-988922e78350 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:19.381742 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-3787ce66-c792-4896-8b84-988922e78350 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:19.445954 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-3787ce66-c792-4896-8b84-988922e78350 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:58:19.453526 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-3787ce66-c792-4896-8b84-988922e78350 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7" status: 200 len: 1210 microversion: 2.1 time: 0.088168 Jun 27 18:58:19.454099 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 546/1107] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:58:19 2022] GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7 => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:58:20.470998 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-3eb733eb-66a9-4b0b-ab2e-f616d781384e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:58:20.471792 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-3eb733eb-66a9-4b0b-ab2e-f616d781384e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: dc46224b-17f7-473f-be38-fd61c04db9d7] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:58:20.478776 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3eb733eb-66a9-4b0b-ab2e-f616d781384e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:20.479380 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3eb733eb-66a9-4b0b-ab2e-f616d781384e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:20.480223 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3eb733eb-66a9-4b0b-ab2e-f616d781384e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:20.480734 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-3eb733eb-66a9-4b0b-ab2e-f616d781384e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:20.913500 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-3eb733eb-66a9-4b0b-ab2e-f616d781384e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:58:20.923213 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-3eb733eb-66a9-4b0b-ab2e-f616d781384e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7" status: 200 len: 1266 microversion: 2.1 time: 0.456344 Jun 27 18:58:20.933350 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 562/1108] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:58:20 2022] GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7 => generated 1266 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:58:20.973308 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-e866755f-96cc-4135-87fc-bd105e09d2b6 req-00324925-30dc-4b98-a8a0-6bb0f2ac4f6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc46224b-17f7-473f-be38-fd61c04db9d7", "tag": "e6adb82e-f924-47f8-a278-e87976d69e5f"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:58:20.994249 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-e866755f-96cc-4135-87fc-bd105e09d2b6 req-00324925-30dc-4b98-a8a0-6bb0f2ac4f6a service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:20.994249 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-e866755f-96cc-4135-87fc-bd105e09d2b6 req-00324925-30dc-4b98-a8a0-6bb0f2ac4f6a service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:21.004243 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-e866755f-96cc-4135-87fc-bd105e09d2b6 req-00324925-30dc-4b98-a8a0-6bb0f2ac4f6a service nova] Creating event network-changed:e6adb82e-f924-47f8-a278-e87976d69e5f for instance dc46224b-17f7-473f-be38-fd61c04db9d7 on hv-cinder-84460 Jun 27 18:58:21.010195 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-e866755f-96cc-4135-87fc-bd105e09d2b6 req-00324925-30dc-4b98-a8a0-6bb0f2ac4f6a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045324 Jun 27 18:58:21.010930 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 547/1109] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 18:58:21.940209 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-c6dc415c-9211-4b15-9cf3-2f3f0910c26f tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:58:21.940764 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-c6dc415c-9211-4b15-9cf3-2f3f0910c26f tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: dc46224b-17f7-473f-be38-fd61c04db9d7] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:58:21.947853 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c6dc415c-9211-4b15-9cf3-2f3f0910c26f tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:21.948307 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c6dc415c-9211-4b15-9cf3-2f3f0910c26f tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:21.949074 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c6dc415c-9211-4b15-9cf3-2f3f0910c26f tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:21.949515 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-c6dc415c-9211-4b15-9cf3-2f3f0910c26f tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:22.078723 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-c6dc415c-9211-4b15-9cf3-2f3f0910c26f tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:58:22.087118 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-c6dc415c-9211-4b15-9cf3-2f3f0910c26f tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7" status: 200 len: 1266 microversion: 2.1 time: 0.150791 Jun 27 18:58:22.087680 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 563/1110] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:58:21 2022] GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:58:23.105899 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-603aeef6-da9f-4575-8d65-48d212c7f528 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:58:23.106628 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-603aeef6-da9f-4575-8d65-48d212c7f528 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: dc46224b-17f7-473f-be38-fd61c04db9d7] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:58:23.112821 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-603aeef6-da9f-4575-8d65-48d212c7f528 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:23.113267 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-603aeef6-da9f-4575-8d65-48d212c7f528 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:23.114030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-603aeef6-da9f-4575-8d65-48d212c7f528 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:23.114490 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-603aeef6-da9f-4575-8d65-48d212c7f528 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:23.246121 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-603aeef6-da9f-4575-8d65-48d212c7f528 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:58:23.253749 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-603aeef6-da9f-4575-8d65-48d212c7f528 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7" status: 200 len: 1266 microversion: 2.1 time: 0.153394 Jun 27 18:58:23.254305 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 548/1111] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:58:23 2022] GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:58:24.271214 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-877bd659-0b52-42ab-8dc5-7fb9f8e7463a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:58:24.271912 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-877bd659-0b52-42ab-8dc5-7fb9f8e7463a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: dc46224b-17f7-473f-be38-fd61c04db9d7] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:58:24.278267 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-877bd659-0b52-42ab-8dc5-7fb9f8e7463a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:24.278755 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-877bd659-0b52-42ab-8dc5-7fb9f8e7463a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:24.279526 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-877bd659-0b52-42ab-8dc5-7fb9f8e7463a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:24.279966 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-877bd659-0b52-42ab-8dc5-7fb9f8e7463a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:24.412217 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-877bd659-0b52-42ab-8dc5-7fb9f8e7463a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:58:24.420224 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-877bd659-0b52-42ab-8dc5-7fb9f8e7463a tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7" status: 200 len: 1266 microversion: 2.1 time: 0.152911 Jun 27 18:58:24.420797 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 564/1112] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:58:24 2022] GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:58:25.437816 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-95bd426c-2d9f-4da6-b9bc-a79243f728c7 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:58:25.438463 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-95bd426c-2d9f-4da6-b9bc-a79243f728c7 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: dc46224b-17f7-473f-be38-fd61c04db9d7] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:58:25.445811 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-95bd426c-2d9f-4da6-b9bc-a79243f728c7 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:25.446262 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-95bd426c-2d9f-4da6-b9bc-a79243f728c7 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:25.447051 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-95bd426c-2d9f-4da6-b9bc-a79243f728c7 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:25.447491 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-95bd426c-2d9f-4da6-b9bc-a79243f728c7 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:25.576850 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-95bd426c-2d9f-4da6-b9bc-a79243f728c7 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:58:25.584208 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-95bd426c-2d9f-4da6-b9bc-a79243f728c7 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7" status: 200 len: 1266 microversion: 2.1 time: 0.150303 Jun 27 18:58:25.584783 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 549/1113] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:58:25 2022] GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:58:26.601757 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-257d9f4e-92ce-4c73-8e05-0fa9a5ff0e2b tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:58:26.602343 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-257d9f4e-92ce-4c73-8e05-0fa9a5ff0e2b tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: dc46224b-17f7-473f-be38-fd61c04db9d7] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:58:26.604492 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=2 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:26.605141 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell0:SELECT=6 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:26.609920 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-257d9f4e-92ce-4c73-8e05-0fa9a5ff0e2b tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:26.620811 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-257d9f4e-92ce-4c73-8e05-0fa9a5ff0e2b tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:26.620811 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-257d9f4e-92ce-4c73-8e05-0fa9a5ff0e2b tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:26.620811 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-257d9f4e-92ce-4c73-8e05-0fa9a5ff0e2b tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:26.746191 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-257d9f4e-92ce-4c73-8e05-0fa9a5ff0e2b tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:58:26.753932 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-257d9f4e-92ce-4c73-8e05-0fa9a5ff0e2b tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7" status: 200 len: 1266 microversion: 2.1 time: 0.156743 Jun 27 18:58:26.754501 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 565/1114] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:58:26 2022] GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:58:27.770464 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-94a02263-a4eb-49c0-97e0-59bd975a4616 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:58:27.771030 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-94a02263-a4eb-49c0-97e0-59bd975a4616 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: dc46224b-17f7-473f-be38-fd61c04db9d7] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:58:27.773460 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell0:SELECT=2 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:27.778644 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-94a02263-a4eb-49c0-97e0-59bd975a4616 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:27.779102 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-94a02263-a4eb-49c0-97e0-59bd975a4616 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:27.779866 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-94a02263-a4eb-49c0-97e0-59bd975a4616 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:27.780306 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-94a02263-a4eb-49c0-97e0-59bd975a4616 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:27.909070 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-94a02263-a4eb-49c0-97e0-59bd975a4616 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:58:27.917419 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-94a02263-a4eb-49c0-97e0-59bd975a4616 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7" status: 200 len: 1266 microversion: 2.1 time: 0.150997 Jun 27 18:58:27.918000 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 550/1115] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:58:27 2022] GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:58:28.934354 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-fd183aa1-6d77-4f10-8d05-5c0e0b8607e3 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:58:28.934995 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-fd183aa1-6d77-4f10-8d05-5c0e0b8607e3 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: dc46224b-17f7-473f-be38-fd61c04db9d7] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:58:28.941440 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd183aa1-6d77-4f10-8d05-5c0e0b8607e3 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:28.941883 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd183aa1-6d77-4f10-8d05-5c0e0b8607e3 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:28.942671 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd183aa1-6d77-4f10-8d05-5c0e0b8607e3 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:28.943102 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-fd183aa1-6d77-4f10-8d05-5c0e0b8607e3 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:29.075475 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-fd183aa1-6d77-4f10-8d05-5c0e0b8607e3 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:58:29.082878 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-fd183aa1-6d77-4f10-8d05-5c0e0b8607e3 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7" status: 200 len: 1266 microversion: 2.1 time: 0.153551 Jun 27 18:58:29.089633 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 566/1116] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:58:28 2022] GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:58:30.101108 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-4a1f5e8f-9eca-475b-b8a0-869fcfcc2a5c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:58:30.101885 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-4a1f5e8f-9eca-475b-b8a0-869fcfcc2a5c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: dc46224b-17f7-473f-be38-fd61c04db9d7] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:58:30.108591 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4a1f5e8f-9eca-475b-b8a0-869fcfcc2a5c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:30.112170 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4a1f5e8f-9eca-475b-b8a0-869fcfcc2a5c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:30.112170 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4a1f5e8f-9eca-475b-b8a0-869fcfcc2a5c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:30.112170 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4a1f5e8f-9eca-475b-b8a0-869fcfcc2a5c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:30.241288 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-4a1f5e8f-9eca-475b-b8a0-869fcfcc2a5c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:58:30.249438 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-4a1f5e8f-9eca-475b-b8a0-869fcfcc2a5c tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7" status: 200 len: 1266 microversion: 2.1 time: 0.152317 Jun 27 18:58:30.249997 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 551/1117] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:58:30 2022] GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:58:31.266864 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-8ea459d3-24be-40da-843d-b1063f7f1418 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:58:31.267418 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-8ea459d3-24be-40da-843d-b1063f7f1418 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: dc46224b-17f7-473f-be38-fd61c04db9d7] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:58:31.273372 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8ea459d3-24be-40da-843d-b1063f7f1418 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:31.274540 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8ea459d3-24be-40da-843d-b1063f7f1418 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:31.275301 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8ea459d3-24be-40da-843d-b1063f7f1418 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:31.275741 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-8ea459d3-24be-40da-843d-b1063f7f1418 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:31.409201 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-8ea459d3-24be-40da-843d-b1063f7f1418 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:58:31.416846 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-8ea459d3-24be-40da-843d-b1063f7f1418 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7" status: 200 len: 1266 microversion: 2.1 time: 0.154114 Jun 27 18:58:31.417423 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 567/1118] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:58:31 2022] GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:58:32.434008 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-4f9aa802-a9b4-45ee-8bfb-4edbab09a131 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:58:32.434635 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-4f9aa802-a9b4-45ee-8bfb-4edbab09a131 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: dc46224b-17f7-473f-be38-fd61c04db9d7] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:58:32.441365 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4f9aa802-a9b4-45ee-8bfb-4edbab09a131 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:32.441813 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4f9aa802-a9b4-45ee-8bfb-4edbab09a131 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:32.442618 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4f9aa802-a9b4-45ee-8bfb-4edbab09a131 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:32.443055 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-4f9aa802-a9b4-45ee-8bfb-4edbab09a131 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:32.474170 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [req-212e50d7-b550-47f3-9466-811bddd12ce8 req-9b513ae3-89ab-474a-8105-eed56d79a935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc46224b-17f7-473f-be38-fd61c04db9d7", "name": "network-vif-plugged", "status": "completed", "tag": "e6adb82e-f924-47f8-a278-e87976d69e5f"}]} {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:58:32.487483 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-212e50d7-b550-47f3-9466-811bddd12ce8 req-9b513ae3-89ab-474a-8105-eed56d79a935 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:32.487918 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [req-212e50d7-b550-47f3-9466-811bddd12ce8 req-9b513ae3-89ab-474a-8105-eed56d79a935 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:32.499965 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.compute.server_external_events [req-212e50d7-b550-47f3-9466-811bddd12ce8 req-9b513ae3-89ab-474a-8105-eed56d79a935 service nova] Creating event network-vif-plugged:e6adb82e-f924-47f8-a278-e87976d69e5f for instance dc46224b-17f7-473f-be38-fd61c04db9d7 on hv-cinder-84460 Jun 27 18:58:32.505648 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [req-212e50d7-b550-47f3-9466-811bddd12ce8 req-9b513ae3-89ab-474a-8105-eed56d79a935 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035424 Jun 27 18:58:32.506289 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 568/1119] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 18:58:32.590216 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-4f9aa802-a9b4-45ee-8bfb-4edbab09a131 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:58:32.598706 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-4f9aa802-a9b4-45ee-8bfb-4edbab09a131 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7" status: 200 len: 1266 microversion: 2.1 time: 0.169433 Jun 27 18:58:32.599292 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 552/1120] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:58:32 2022] GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:58:33.617003 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-730d2f2b-c594-4204-a292-d8a67b65bc9b tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:58:33.618176 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-730d2f2b-c594-4204-a292-d8a67b65bc9b tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: dc46224b-17f7-473f-be38-fd61c04db9d7] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:58:33.625183 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-730d2f2b-c594-4204-a292-d8a67b65bc9b tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:33.625631 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-730d2f2b-c594-4204-a292-d8a67b65bc9b tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:33.626654 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-730d2f2b-c594-4204-a292-d8a67b65bc9b tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:33.627103 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-730d2f2b-c594-4204-a292-d8a67b65bc9b tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:33.758577 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-730d2f2b-c594-4204-a292-d8a67b65bc9b tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:58:33.765818 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-730d2f2b-c594-4204-a292-d8a67b65bc9b tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7" status: 200 len: 1266 microversion: 2.1 time: 0.153029 Jun 27 18:58:33.766375 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 569/1121] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:58:33 2022] GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:58:34.782752 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-d4ac56d0-a610-47a7-9a14-2cdb364a2470 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:58:34.783365 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-d4ac56d0-a610-47a7-9a14-2cdb364a2470 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: dc46224b-17f7-473f-be38-fd61c04db9d7] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:58:34.790265 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d4ac56d0-a610-47a7-9a14-2cdb364a2470 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:34.790749 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d4ac56d0-a610-47a7-9a14-2cdb364a2470 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:34.791518 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d4ac56d0-a610-47a7-9a14-2cdb364a2470 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:34.791961 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-d4ac56d0-a610-47a7-9a14-2cdb364a2470 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:34.923429 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-d4ac56d0-a610-47a7-9a14-2cdb364a2470 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:58:34.931017 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-d4ac56d0-a610-47a7-9a14-2cdb364a2470 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7" status: 200 len: 1453 microversion: 2.1 time: 0.152262 Jun 27 18:58:34.931616 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 553/1122] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:58:34 2022] GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:58:34.947496 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-a9bae141-2311-4791-8892-c8d87b5257a1 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 18:58:34.948112 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-a9bae141-2311-4791-8892-c8d87b5257a1 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: dc46224b-17f7-473f-be38-fd61c04db9d7] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 18:58:34.954596 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a9bae141-2311-4791-8892-c8d87b5257a1 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:34.955047 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a9bae141-2311-4791-8892-c8d87b5257a1 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:34.955807 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a9bae141-2311-4791-8892-c8d87b5257a1 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:34.956241 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-a9bae141-2311-4791-8892-c8d87b5257a1 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:35.083523 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-a9bae141-2311-4791-8892-c8d87b5257a1 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 18:58:35.091825 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-a9bae141-2311-4791-8892-c8d87b5257a1 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7" status: 200 len: 1453 microversion: 2.1 time: 0.148205 Jun 27 18:58:35.092417 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 570/1123] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 18:58:34 2022] GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7 => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 18:58:37.004761 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-5fbb1408-055c-4517-ac16-f9e6c09f3275 req-6640d1d3-f4e9-40d8-ab1a-0daa37038cfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc46224b-17f7-473f-be38-fd61c04db9d7", "tag": "e6adb82e-f924-47f8-a278-e87976d69e5f"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 18:58:37.007818 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-5fbb1408-055c-4517-ac16-f9e6c09f3275 req-6640d1d3-f4e9-40d8-ab1a-0daa37038cfe service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 18:58:37.008640 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-5fbb1408-055c-4517-ac16-f9e6c09f3275 req-6640d1d3-f4e9-40d8-ab1a-0daa37038cfe service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 18:58:37.020814 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-5fbb1408-055c-4517-ac16-f9e6c09f3275 req-6640d1d3-f4e9-40d8-ab1a-0daa37038cfe service nova] Creating event network-changed:e6adb82e-f924-47f8-a278-e87976d69e5f for instance dc46224b-17f7-473f-be38-fd61c04db9d7 on hv-cinder-84460 Jun 27 18:58:37.026172 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-5fbb1408-055c-4517-ac16-f9e6c09f3275 req-6640d1d3-f4e9-40d8-ab1a-0daa37038cfe service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030944 Jun 27 18:58:37.026969 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 554/1124] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 18:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 19:00:09.051908 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 19:00:09.055205 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_api:SELECT=22 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 19:00:09.055989 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG dbcounter [-] [124717] Writing DB stats nova_cell1:SELECT=46 {{(pid=124717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 19:00:09.059151 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG dbcounter [-] [124716] Writing DB stats nova_cell1:SELECT=58 {{(pid=124716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 19:00:09.063088 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-b079cafa-11c8-4628-b886-2e9853c965d6 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 19:00:09.065353 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-97bb2361-3326-48f9-9899-6aead99c7afa req-3776d368-8d46-44e7-8866-a66ab11334cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc46224b-17f7-473f-be38-fd61c04db9d7", "tag": "e6adb82e-f924-47f8-a278-e87976d69e5f"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 19:00:09.069850 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-b079cafa-11c8-4628-b886-2e9853c965d6 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: dc46224b-17f7-473f-be38-fd61c04db9d7] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 19:00:09.074176 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-97bb2361-3326-48f9-9899-6aead99c7afa req-3776d368-8d46-44e7-8866-a66ab11334cc service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:09.074669 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-97bb2361-3326-48f9-9899-6aead99c7afa req-3776d368-8d46-44e7-8866-a66ab11334cc service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:09.078047 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b079cafa-11c8-4628-b886-2e9853c965d6 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:09.079176 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b079cafa-11c8-4628-b886-2e9853c965d6 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:09.080044 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b079cafa-11c8-4628-b886-2e9853c965d6 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:09.080779 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-b079cafa-11c8-4628-b886-2e9853c965d6 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:09.087131 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-97bb2361-3326-48f9-9899-6aead99c7afa req-3776d368-8d46-44e7-8866-a66ab11334cc service nova] Creating event network-changed:e6adb82e-f924-47f8-a278-e87976d69e5f for instance dc46224b-17f7-473f-be38-fd61c04db9d7 on hv-cinder-84460 Jun 27 19:00:09.094921 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-97bb2361-3326-48f9-9899-6aead99c7afa req-3776d368-8d46-44e7-8866-a66ab11334cc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040403 Jun 27 19:00:09.095897 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 555/1125] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 19:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 19:00:09.109075 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-b079cafa-11c8-4628-b886-2e9853c965d6 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: dc46224b-17f7-473f-be38-fd61c04db9d7] Going to try to terminate instance {{(pid=124716) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 19:00:09.399582 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-b079cafa-11c8-4628-b886-2e9853c965d6 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7" status: 204 len: 0 microversion: 2.1 time: 0.349496 Jun 27 19:00:09.403651 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 571/1126] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 19:00:09 2022] DELETE /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 19:00:09.410579 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-ab13576a-975f-4214-8f04-b9f1cdde1fdb tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 19:00:09.411285 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-ab13576a-975f-4214-8f04-b9f1cdde1fdb tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: dc46224b-17f7-473f-be38-fd61c04db9d7] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 19:00:09.418297 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ab13576a-975f-4214-8f04-b9f1cdde1fdb tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:09.418716 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ab13576a-975f-4214-8f04-b9f1cdde1fdb tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:09.419477 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ab13576a-975f-4214-8f04-b9f1cdde1fdb tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:09.419911 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-ab13576a-975f-4214-8f04-b9f1cdde1fdb tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:09.757324 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-ab13576a-975f-4214-8f04-b9f1cdde1fdb tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 19:00:09.765241 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-ab13576a-975f-4214-8f04-b9f1cdde1fdb tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7" status: 200 len: 1578 microversion: 2.1 time: 0.360380 Jun 27 19:00:09.766338 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 556/1127] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 19:00:09 2022] GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7 => generated 1578 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 19:00:10.784264 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-afa70427-d199-45ce-8ab4-74efb7e5f167 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 19:00:10.784970 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-afa70427-d199-45ce-8ab4-74efb7e5f167 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: dc46224b-17f7-473f-be38-fd61c04db9d7] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 19:00:10.791756 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-afa70427-d199-45ce-8ab4-74efb7e5f167 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:10.792207 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-afa70427-d199-45ce-8ab4-74efb7e5f167 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:10.792978 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-afa70427-d199-45ce-8ab4-74efb7e5f167 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:10.793419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-afa70427-d199-45ce-8ab4-74efb7e5f167 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:11.224591 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-afa70427-d199-45ce-8ab4-74efb7e5f167 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 19:00:11.232147 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-afa70427-d199-45ce-8ab4-74efb7e5f167 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7" status: 200 len: 1578 microversion: 2.1 time: 0.452266 Jun 27 19:00:11.232718 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 572/1128] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 19:00:10 2022] GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7 => generated 1578 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 19:00:11.531071 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-875bf76b-e1f7-4cd1-851c-129dd6943e26 req-f35bbd65-f8ae-4611-bd83-bcaac75cdef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc46224b-17f7-473f-be38-fd61c04db9d7", "name": "network-vif-deleted", "tag": "e6adb82e-f924-47f8-a278-e87976d69e5f"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 19:00:11.540310 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-875bf76b-e1f7-4cd1-851c-129dd6943e26 req-f35bbd65-f8ae-4611-bd83-bcaac75cdef2 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:11.540744 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-875bf76b-e1f7-4cd1-851c-129dd6943e26 req-f35bbd65-f8ae-4611-bd83-bcaac75cdef2 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:11.551303 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-875bf76b-e1f7-4cd1-851c-129dd6943e26 req-f35bbd65-f8ae-4611-bd83-bcaac75cdef2 service nova] Creating event network-vif-deleted:e6adb82e-f924-47f8-a278-e87976d69e5f for instance dc46224b-17f7-473f-be38-fd61c04db9d7 on hv-cinder-84460 Jun 27 19:00:11.556008 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-875bf76b-e1f7-4cd1-851c-129dd6943e26 req-f35bbd65-f8ae-4611-bd83-bcaac75cdef2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028584 Jun 27 19:00:11.556578 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 557/1129] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 19:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 19:00:12.249409 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-46e6c5f3-ae13-4c1b-9474-cb05eac9e612 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 19:00:12.250111 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-46e6c5f3-ae13-4c1b-9474-cb05eac9e612 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: dc46224b-17f7-473f-be38-fd61c04db9d7] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 19:00:12.257445 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-46e6c5f3-ae13-4c1b-9474-cb05eac9e612 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:12.257897 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-46e6c5f3-ae13-4c1b-9474-cb05eac9e612 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:12.258684 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-46e6c5f3-ae13-4c1b-9474-cb05eac9e612 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:12.259121 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-46e6c5f3-ae13-4c1b-9474-cb05eac9e612 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:12.295705 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-46e6c5f3-ae13-4c1b-9474-cb05eac9e612 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:12.296072 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-46e6c5f3-ae13-4c1b-9474-cb05eac9e612 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:12.296521 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.objects.instance [None req-46e6c5f3-ae13-4c1b-9474-cb05eac9e612 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lazy-loading 'fault' on Instance uuid dc46224b-17f7-473f-be38-fd61c04db9d7 {{(pid=124716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 19:00:12.336684 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-46e6c5f3-ae13-4c1b-9474-cb05eac9e612 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 19:00:12.344418 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-46e6c5f3-ae13-4c1b-9474-cb05eac9e612 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7" status: 200 len: 1230 microversion: 2.1 time: 0.098737 Jun 27 19:00:12.344977 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 573/1130] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 19:00:12 2022] GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7 => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 19:00:13.364151 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-72de7e95-1922-44af-b3ad-e25b02c63efe tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 19:00:13.372649 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-72de7e95-1922-44af-b3ad-e25b02c63efe tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: dc46224b-17f7-473f-be38-fd61c04db9d7] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 19:00:13.372649 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-72de7e95-1922-44af-b3ad-e25b02c63efe tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:13.372649 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-72de7e95-1922-44af-b3ad-e25b02c63efe tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:13.372649 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-72de7e95-1922-44af-b3ad-e25b02c63efe tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:13.373061 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-72de7e95-1922-44af-b3ad-e25b02c63efe tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:13.386207 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-72de7e95-1922-44af-b3ad-e25b02c63efe tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] HTTP exception thrown: Instance dc46224b-17f7-473f-be38-fd61c04db9d7 could not be found. Jun 27 19:00:13.387836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-72de7e95-1922-44af-b3ad-e25b02c63efe tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Request method failure captured: Jun 27 19:00:13.387836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7 HTTP/1.1 Jun 27 19:00:13.387836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 19:00:13.387836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 19:00:13.387836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 19:00:13.387836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 0 Jun 27 19:00:13.387836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 19:00:13.387836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 19:00:13.387836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 19:00:13.387836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 19:00:13.387836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufyWEjJov3JiU-YrLnGIA-MtRkVnK36MM3Ev0CxpUUs5JXBejK5bS4jy4vO4aWP1DSRdHS7A-cmf1gda5kTIC1ni20jGE9ZSSLpqjqRuJ1NMKOpUux-izX42ZMVXcqmOqbBASExCJXHVOPCk2rNiLhag2AFIXSh4x53KMuBgfbEdjEE Jun 27 19:00:13.387836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 19:00:13.387836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 19:00:13.387836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 19:00:13.387836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 19:00:13.387836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 19:00:13.387836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 19:00:13.387836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: 302e8c5b4c1f422fbd5cf5602a094d2e Jun 27 19:00:13.387836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-TestVolumeBootPattern-178305863 Jun 27 19:00:13.387836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 19:00:13.387836 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 19:00:13.389599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/302e8c5b4c1f422fbd5cf5602a094d2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/302e8c5b4c1f422fbd5cf5602a094d2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_302e8c5b4c1f422fbd5cf5602a094d2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/302e8c5b4c1f422fbd5cf5602a094d2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 19:00:13.389599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-TestVolumeBootPattern-178305863 Jun 27 19:00:13.389599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: 302e8c5b4c1f422fbd5cf5602a094d2e Jun 27 19:00:13.389599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-TestVolumeBootPattern-178305863 Jun 27 19:00:13.389599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-TestVolumeBootPattern-178305863-project Jun 27 19:00:13.389599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 19:00:13.389599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 19:00:13.389599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: b10a90cce1b048d7bd55938811301ab4 Jun 27 19:00:13.389599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-TestVolumeBootPattern-178305863-project Jun 27 19:00:13.389599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: > Jun 27 19:00:13.389599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Instance dc46224b-17f7-473f-be38-fd61c04db9d7 could not be found. Jun 27 19:00:13.389599 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'id': 'dc46224b-17f7-473f-be38-fd61c04db9d7'} Jun 27 19:00:13.390626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 19:00:13.390626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 19:00:13.390626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 19:00:13.390626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 19:00:13.390626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 19:00:13.390626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 19:00:13.390626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 19:00:13.390626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 19:00:13.390626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 19:00:13.390626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 19:00:13.390626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc46224b-17f7-473f-be38-fd61c04db9d7 could not be found. Jun 27 19:00:13.390626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 19:00:13.390626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 19:00:13.390626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 19:00:13.390626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 19:00:13.390626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 19:00:13.390626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 19:00:13.390626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 19:00:13.390626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 19:00:13.390626 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 19:00:13.392911 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 19:00:13.392911 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 19:00:13.392911 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 19:00:13.392911 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 19:00:13.392911 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 19:00:13.392911 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 19:00:13.392911 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 19:00:13.392911 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc46224b-17f7-473f-be38-fd61c04db9d7 could not be found. Jun 27 19:00:13.392911 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 19:00:13.392911 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 19:00:13.392911 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 19:00:13.392911 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 19:00:13.392911 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 19:00:13.392911 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 19:00:13.392911 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 19:00:13.392911 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 19:00:13.392911 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc46224b-17f7-473f-be38-fd61c04db9d7 could not be found. Jun 27 19:00:13.392911 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 19:00:13.394543 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-72de7e95-1922-44af-b3ad-e25b02c63efe tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Returning 404 to user: Instance dc46224b-17f7-473f-be38-fd61c04db9d7 could not be found. {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 19:00:13.394543 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-72de7e95-1922-44af-b3ad-e25b02c63efe tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7" status: 404 len: 111 microversion: 2.1 time: 0.030492 Jun 27 19:00:13.394543 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 558/1131] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 19:00:13 2022] GET /compute/v2.1/servers/dc46224b-17f7-473f-be38-fd61c04db9d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 19:00:14.756647 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 19:00:14.757479 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Mon Jun 27 19:00:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 19:00:16.653520 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-727e8cde-9a39-4ec7-aa20-f55f7dfaba2d tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 19:00:16.654153 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-727e8cde-9a39-4ec7-aa20-f55f7dfaba2d tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 16771a29-9fe8-4864-968e-645bc86cc969] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 19:00:16.660045 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-bdf82a36-4eb3-4e83-8243-e637ba136039 req-743b543d-fc53-430d-b6b8-922822cf33b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16771a29-9fe8-4864-968e-645bc86cc969", "tag": "73b7ba71-0c22-43f7-a800-e4ea470160f2"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 19:00:16.661454 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-727e8cde-9a39-4ec7-aa20-f55f7dfaba2d tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:16.661910 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-727e8cde-9a39-4ec7-aa20-f55f7dfaba2d tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:16.662910 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-727e8cde-9a39-4ec7-aa20-f55f7dfaba2d tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:16.663377 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-727e8cde-9a39-4ec7-aa20-f55f7dfaba2d tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:16.669423 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-bdf82a36-4eb3-4e83-8243-e637ba136039 req-743b543d-fc53-430d-b6b8-922822cf33b9 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:16.669871 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-bdf82a36-4eb3-4e83-8243-e637ba136039 req-743b543d-fc53-430d-b6b8-922822cf33b9 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:16.681637 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-bdf82a36-4eb3-4e83-8243-e637ba136039 req-743b543d-fc53-430d-b6b8-922822cf33b9 service nova] Creating event network-changed:73b7ba71-0c22-43f7-a800-e4ea470160f2 for instance 16771a29-9fe8-4864-968e-645bc86cc969 on hv-cinder-84460 Jun 27 19:00:16.686973 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-bdf82a36-4eb3-4e83-8243-e637ba136039 req-743b543d-fc53-430d-b6b8-922822cf33b9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031594 Jun 27 19:00:16.688402 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 559/1132] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 19:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 19:00:16.692149 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-727e8cde-9a39-4ec7-aa20-f55f7dfaba2d tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 16771a29-9fe8-4864-968e-645bc86cc969] Going to try to terminate instance {{(pid=124716) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 19:00:16.999820 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-727e8cde-9a39-4ec7-aa20-f55f7dfaba2d tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "DELETE /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969" status: 204 len: 0 microversion: 2.1 time: 0.349952 Jun 27 19:00:17.000677 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 574/1133] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 19:00:16 2022] DELETE /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 19:00:17.009665 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-94be53f3-ece4-40a5-9543-c69f2c965fb9 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 19:00:17.014994 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-94be53f3-ece4-40a5-9543-c69f2c965fb9 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 16771a29-9fe8-4864-968e-645bc86cc969] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 19:00:17.016993 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-94be53f3-ece4-40a5-9543-c69f2c965fb9 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:17.017507 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-94be53f3-ece4-40a5-9543-c69f2c965fb9 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:17.018479 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-94be53f3-ece4-40a5-9543-c69f2c965fb9 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:17.018996 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-94be53f3-ece4-40a5-9543-c69f2c965fb9 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:17.152748 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.policy [None req-94be53f3-ece4-40a5-9543-c69f2c965fb9 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124717) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 19:00:17.160480 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-94be53f3-ece4-40a5-9543-c69f2c965fb9 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969" status: 200 len: 1578 microversion: 2.1 time: 0.155033 Jun 27 19:00:17.161047 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 560/1134] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 19:00:17 2022] GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 19:00:18.177746 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-34a47bf2-e172-48b3-acc9-9f5c920e0132 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 19:00:18.178701 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-34a47bf2-e172-48b3-acc9-9f5c920e0132 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 16771a29-9fe8-4864-968e-645bc86cc969] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 19:00:18.185177 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-34a47bf2-e172-48b3-acc9-9f5c920e0132 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:18.199347 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-34a47bf2-e172-48b3-acc9-9f5c920e0132 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:18.199347 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-34a47bf2-e172-48b3-acc9-9f5c920e0132 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:18.199347 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-34a47bf2-e172-48b3-acc9-9f5c920e0132 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:18.321256 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-34a47bf2-e172-48b3-acc9-9f5c920e0132 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 19:00:18.329350 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-34a47bf2-e172-48b3-acc9-9f5c920e0132 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969" status: 200 len: 1578 microversion: 2.1 time: 0.155882 Jun 27 19:00:18.329908 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 575/1135] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 19:00:18 2022] GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 19:00:18.962552 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [req-473bb3b4-1283-41fd-9caf-dcf1c96ec688 req-59115421-152f-4a57-b75e-cf193145e525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16771a29-9fe8-4864-968e-645bc86cc969", "name": "network-vif-deleted", "tag": "73b7ba71-0c22-43f7-a800-e4ea470160f2"}]} {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 19:00:18.972569 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-473bb3b4-1283-41fd-9caf-dcf1c96ec688 req-59115421-152f-4a57-b75e-cf193145e525 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:18.973016 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [req-473bb3b4-1283-41fd-9caf-dcf1c96ec688 req-59115421-152f-4a57-b75e-cf193145e525 service nova] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:18.983867 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.compute.server_external_events [req-473bb3b4-1283-41fd-9caf-dcf1c96ec688 req-59115421-152f-4a57-b75e-cf193145e525 service nova] Creating event network-vif-deleted:73b7ba71-0c22-43f7-a800-e4ea470160f2 for instance 16771a29-9fe8-4864-968e-645bc86cc969 on hv-cinder-84460 Jun 27 19:00:18.989151 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [req-473bb3b4-1283-41fd-9caf-dcf1c96ec688 req-59115421-152f-4a57-b75e-cf193145e525 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030456 Jun 27 19:00:18.989717 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 561/1136] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Jun 27 19:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 19:00:19.346399 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-ac7e0488-a690-4f63-8b61-06965b0a0e9f tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 19:00:19.347041 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-ac7e0488-a690-4f63-8b61-06965b0a0e9f tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 16771a29-9fe8-4864-968e-645bc86cc969] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 19:00:19.357005 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ac7e0488-a690-4f63-8b61-06965b0a0e9f tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:19.357458 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ac7e0488-a690-4f63-8b61-06965b0a0e9f tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:19.358235 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ac7e0488-a690-4f63-8b61-06965b0a0e9f tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:19.358703 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-ac7e0488-a690-4f63-8b61-06965b0a0e9f tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:19.423678 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.policy [None req-ac7e0488-a690-4f63-8b61-06965b0a0e9f tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a90cce1b048d7bd55938811301ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302e8c5b4c1f422fbd5cf5602a094d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124716) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 19:00:19.432085 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-ac7e0488-a690-4f63-8b61-06965b0a0e9f tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969" status: 200 len: 1225 microversion: 2.1 time: 0.090271 Jun 27 19:00:19.432657 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 576/1137] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 19:00:19 2022] GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 19:00:20.451162 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-1f7c1318-0fc1-43fa-ae0c-54de33a926ed tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 19:00:20.451940 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-1f7c1318-0fc1-43fa-ae0c-54de33a926ed tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 16771a29-9fe8-4864-968e-645bc86cc969] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 19:00:20.458837 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1f7c1318-0fc1-43fa-ae0c-54de33a926ed tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:20.459356 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1f7c1318-0fc1-43fa-ae0c-54de33a926ed tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:20.460316 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1f7c1318-0fc1-43fa-ae0c-54de33a926ed tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:20.460767 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-1f7c1318-0fc1-43fa-ae0c-54de33a926ed tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:20.474597 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-1f7c1318-0fc1-43fa-ae0c-54de33a926ed tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] HTTP exception thrown: Instance 16771a29-9fe8-4864-968e-645bc86cc969 could not be found. Jun 27 19:00:20.476219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-1f7c1318-0fc1-43fa-ae0c-54de33a926ed tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Request method failure captured: Jun 27 19:00:20.476219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969 HTTP/1.1 Jun 27 19:00:20.476219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 19:00:20.476219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 19:00:20.476219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 19:00:20.476219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 0 Jun 27 19:00:20.476219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 19:00:20.476219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 19:00:20.476219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 19:00:20.476219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 19:00:20.476219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufyWEjJov3JiU-YrLnGIA-MtRkVnK36MM3Ev0CxpUUs5JXBejK5bS4jy4vO4aWP1DSRdHS7A-cmf1gda5kTIC1ni20jGE9ZSSLpqjqRuJ1NMKOpUux-izX42ZMVXcqmOqbBASExCJXHVOPCk2rNiLhag2AFIXSh4x53KMuBgfbEdjEE Jun 27 19:00:20.476219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 19:00:20.476219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 19:00:20.476219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 19:00:20.476219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 19:00:20.476219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 19:00:20.476219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 19:00:20.476219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: 302e8c5b4c1f422fbd5cf5602a094d2e Jun 27 19:00:20.476219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-TestVolumeBootPattern-178305863 Jun 27 19:00:20.476219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 19:00:20.476219 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 19:00:20.477940 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/302e8c5b4c1f422fbd5cf5602a094d2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/302e8c5b4c1f422fbd5cf5602a094d2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_302e8c5b4c1f422fbd5cf5602a094d2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/302e8c5b4c1f422fbd5cf5602a094d2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 19:00:20.477940 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-TestVolumeBootPattern-178305863 Jun 27 19:00:20.477940 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: 302e8c5b4c1f422fbd5cf5602a094d2e Jun 27 19:00:20.477940 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-TestVolumeBootPattern-178305863 Jun 27 19:00:20.477940 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-TestVolumeBootPattern-178305863-project Jun 27 19:00:20.477940 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 19:00:20.477940 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 19:00:20.477940 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: b10a90cce1b048d7bd55938811301ab4 Jun 27 19:00:20.477940 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-TestVolumeBootPattern-178305863-project Jun 27 19:00:20.477940 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: > Jun 27 19:00:20.477940 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Instance 16771a29-9fe8-4864-968e-645bc86cc969 could not be found. Jun 27 19:00:20.477940 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'id': '16771a29-9fe8-4864-968e-645bc86cc969'} Jun 27 19:00:20.478848 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 19:00:20.478848 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 19:00:20.478848 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 19:00:20.478848 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 19:00:20.478848 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 19:00:20.478848 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 19:00:20.478848 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 19:00:20.478848 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 19:00:20.478848 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 19:00:20.478848 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 19:00:20.478848 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16771a29-9fe8-4864-968e-645bc86cc969 could not be found. Jun 27 19:00:20.478848 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 19:00:20.478848 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 19:00:20.478848 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 19:00:20.478848 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 19:00:20.478848 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 19:00:20.478848 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 19:00:20.478848 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 19:00:20.478848 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 19:00:20.478848 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 19:00:20.480207 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 19:00:20.480207 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 19:00:20.480207 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 19:00:20.480207 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 19:00:20.480207 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 19:00:20.480207 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 19:00:20.480207 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 19:00:20.480207 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16771a29-9fe8-4864-968e-645bc86cc969 could not be found. Jun 27 19:00:20.480207 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 19:00:20.480207 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 19:00:20.480207 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 19:00:20.480207 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 19:00:20.480207 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 19:00:20.480207 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 19:00:20.480207 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 19:00:20.480207 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 19:00:20.480207 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16771a29-9fe8-4864-968e-645bc86cc969 could not be found. Jun 27 19:00:20.480207 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 19:00:20.481487 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-1f7c1318-0fc1-43fa-ae0c-54de33a926ed tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Returning 404 to user: Instance 16771a29-9fe8-4864-968e-645bc86cc969 could not be found. {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 19:00:20.481487 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-1f7c1318-0fc1-43fa-ae0c-54de33a926ed tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969" status: 404 len: 111 microversion: 2.1 time: 0.031445 Jun 27 19:00:20.481487 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 562/1138] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 19:00:20 2022] GET /compute/v2.1/servers/16771a29-9fe8-4864-968e-645bc86cc969 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 19:00:21.015275 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-799bfe5a-8892-45ee-a34e-22fa0d55d35e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 19:00:21.016290 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.compute.api [None req-799bfe5a-8892-45ee-a34e-22fa0d55d35e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124716) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 19:00:21.022865 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-799bfe5a-8892-45ee-a34e-22fa0d55d35e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:21.023318 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-799bfe5a-8892-45ee-a34e-22fa0d55d35e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:21.024085 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-799bfe5a-8892-45ee-a34e-22fa0d55d35e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:21.024521 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG oslo_concurrency.lockutils [None req-799bfe5a-8892-45ee-a34e-22fa0d55d35e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:21.038157 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.wsgi [None req-799bfe5a-8892-45ee-a34e-22fa0d55d35e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] HTTP exception thrown: Instance 969bb23c-9265-497a-b68a-70193be0b3f1 could not be found. Jun 27 19:00:21.039860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-799bfe5a-8892-45ee-a34e-22fa0d55d35e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Request method failure captured: Jun 27 19:00:21.039860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: request: DELETE /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 HTTP/1.1 Jun 27 19:00:21.039860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept: application/json Jun 27 19:00:21.039860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Accept-Encoding: identity Jun 27 19:00:21.039860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Connection: close Jun 27 19:00:21.039860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Length: 0 Jun 27 19:00:21.039860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Content-Type: application/json Jun 27 19:00:21.039860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Host: 10.222.0.15 Jun 27 19:00:21.039860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Openstack-System-Scope: None Jun 27 19:00:21.039860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: User-Agent: python-urllib3/1.26.9 Jun 27 19:00:21.039860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Auth-Token: gAAAAABiufyWEjJov3JiU-YrLnGIA-MtRkVnK36MM3Ev0CxpUUs5JXBejK5bS4jy4vO4aWP1DSRdHS7A-cmf1gda5kTIC1ni20jGE9ZSSLpqjqRuJ1NMKOpUux-izX42ZMVXcqmOqbBASExCJXHVOPCk2rNiLhag2AFIXSh4x53KMuBgfbEdjEE Jun 27 19:00:21.039860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Id: None Jun 27 19:00:21.039860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Domain-Name: None Jun 27 19:00:21.039860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Identity-Status: Confirmed Jun 27 19:00:21.039860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Is-Admin-Project: True Jun 27 19:00:21.039860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Id: default Jun 27 19:00:21.039860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Domain-Name: Default Jun 27 19:00:21.039860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Id: 302e8c5b4c1f422fbd5cf5602a094d2e Jun 27 19:00:21.039860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Project-Name: tempest-TestVolumeBootPattern-178305863 Jun 27 19:00:21.039860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Role: reader,member Jun 27 19:00:21.039860 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Roles: reader,member Jun 27 19:00:21.041602 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/302e8c5b4c1f422fbd5cf5602a094d2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/302e8c5b4c1f422fbd5cf5602a094d2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_302e8c5b4c1f422fbd5cf5602a094d2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/302e8c5b4c1f422fbd5cf5602a094d2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 19:00:21.041602 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant: tempest-TestVolumeBootPattern-178305863 Jun 27 19:00:21.041602 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Id: 302e8c5b4c1f422fbd5cf5602a094d2e Jun 27 19:00:21.041602 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-Tenant-Name: tempest-TestVolumeBootPattern-178305863 Jun 27 19:00:21.041602 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User: tempest-TestVolumeBootPattern-178305863-project Jun 27 19:00:21.041602 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Id: default Jun 27 19:00:21.041602 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Domain-Name: Default Jun 27 19:00:21.041602 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Id: b10a90cce1b048d7bd55938811301ab4 Jun 27 19:00:21.041602 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: X-User-Name: tempest-TestVolumeBootPattern-178305863-project Jun 27 19:00:21.041602 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: method: > Jun 27 19:00:21.041602 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: exception: Instance 969bb23c-9265-497a-b68a-70193be0b3f1 could not be found. Jun 27 19:00:21.041602 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: action_args: {'id': '969bb23c-9265-497a-b68a-70193be0b3f1'} Jun 27 19:00:21.042652 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 19:00:21.042652 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 19:00:21.042652 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 19:00:21.042652 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 19:00:21.042652 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 19:00:21.042652 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 19:00:21.042652 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 19:00:21.042652 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 19:00:21.042652 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 19:00:21.042652 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 19:00:21.042652 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 969bb23c-9265-497a-b68a-70193be0b3f1 could not be found. Jun 27 19:00:21.042652 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 19:00:21.042652 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 19:00:21.042652 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 19:00:21.042652 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 19:00:21.042652 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 19:00:21.042652 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 19:00:21.042652 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 19:00:21.042652 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 19:00:21.042652 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 19:00:21.044306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 19:00:21.044306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 19:00:21.044306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 19:00:21.044306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 19:00:21.044306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 19:00:21.044306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 19:00:21.044306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 19:00:21.044306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 19:00:21.044306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 19:00:21.044306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 969bb23c-9265-497a-b68a-70193be0b3f1 could not be found. Jun 27 19:00:21.044306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 19:00:21.044306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 19:00:21.044306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 19:00:21.044306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 19:00:21.044306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 19:00:21.044306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 19:00:21.044306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 19:00:21.044306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 19:00:21.044306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 969bb23c-9265-497a-b68a-70193be0b3f1 could not be found. Jun 27 19:00:21.044306 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: ERROR nova.api.openstack.wsgi Jun 27 19:00:21.046132 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-799bfe5a-8892-45ee-a34e-22fa0d55d35e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Returning 404 to user: Instance 969bb23c-9265-497a-b68a-70193be0b3f1 could not be found. {{(pid=124716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 19:00:21.046132 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-799bfe5a-8892-45ee-a34e-22fa0d55d35e tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "DELETE /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 404 len: 111 microversion: 2.1 time: 0.029910 Jun 27 19:00:21.046132 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 577/1139] 10.222.0.15 () {58 vars in 1238 bytes} [Mon Jun 27 19:00:21 2022] DELETE /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 19:00:21.050704 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-30da8433-3be2-41af-8d78-10eaebf70963 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '>' {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 19:00:21.051344 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.compute.api [None req-30da8433-3be2-41af-8d78-10eaebf70963 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] [instance: 969bb23c-9265-497a-b68a-70193be0b3f1] Fetching instance by UUID {{(pid=124717) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 19:00:21.057286 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-30da8433-3be2-41af-8d78-10eaebf70963 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:21.057746 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-30da8433-3be2-41af-8d78-10eaebf70963 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:21.058548 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-30da8433-3be2-41af-8d78-10eaebf70963 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 19:00:21.058991 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG oslo_concurrency.lockutils [None req-30da8433-3be2-41af-8d78-10eaebf70963 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Lock "22329c9e-12ee-4fdf-a1a3-6d021f43d687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 19:00:21.072059 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.wsgi [None req-30da8433-3be2-41af-8d78-10eaebf70963 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] HTTP exception thrown: Instance 969bb23c-9265-497a-b68a-70193be0b3f1 could not be found. Jun 27 19:00:21.073583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-30da8433-3be2-41af-8d78-10eaebf70963 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Request method failure captured: Jun 27 19:00:21.073583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: request: GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 HTTP/1.1 Jun 27 19:00:21.073583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept: application/json Jun 27 19:00:21.073583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Accept-Encoding: identity Jun 27 19:00:21.073583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Connection: close Jun 27 19:00:21.073583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Length: 0 Jun 27 19:00:21.073583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Content-Type: application/json Jun 27 19:00:21.073583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Host: 10.222.0.15 Jun 27 19:00:21.073583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Openstack-System-Scope: None Jun 27 19:00:21.073583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: User-Agent: python-urllib3/1.26.9 Jun 27 19:00:21.073583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Auth-Token: gAAAAABiufyWEjJov3JiU-YrLnGIA-MtRkVnK36MM3Ev0CxpUUs5JXBejK5bS4jy4vO4aWP1DSRdHS7A-cmf1gda5kTIC1ni20jGE9ZSSLpqjqRuJ1NMKOpUux-izX42ZMVXcqmOqbBASExCJXHVOPCk2rNiLhag2AFIXSh4x53KMuBgfbEdjEE Jun 27 19:00:21.073583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Id: None Jun 27 19:00:21.073583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Domain-Name: None Jun 27 19:00:21.073583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Identity-Status: Confirmed Jun 27 19:00:21.073583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Is-Admin-Project: True Jun 27 19:00:21.073583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Id: default Jun 27 19:00:21.073583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Domain-Name: Default Jun 27 19:00:21.073583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Id: 302e8c5b4c1f422fbd5cf5602a094d2e Jun 27 19:00:21.073583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Project-Name: tempest-TestVolumeBootPattern-178305863 Jun 27 19:00:21.073583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Role: reader,member Jun 27 19:00:21.073583 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Roles: reader,member Jun 27 19:00:21.075501 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/302e8c5b4c1f422fbd5cf5602a094d2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/302e8c5b4c1f422fbd5cf5602a094d2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_302e8c5b4c1f422fbd5cf5602a094d2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/302e8c5b4c1f422fbd5cf5602a094d2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}] Jun 27 19:00:21.075501 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant: tempest-TestVolumeBootPattern-178305863 Jun 27 19:00:21.075501 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Id: 302e8c5b4c1f422fbd5cf5602a094d2e Jun 27 19:00:21.075501 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-Tenant-Name: tempest-TestVolumeBootPattern-178305863 Jun 27 19:00:21.075501 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User: tempest-TestVolumeBootPattern-178305863-project Jun 27 19:00:21.075501 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Id: default Jun 27 19:00:21.075501 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Domain-Name: Default Jun 27 19:00:21.075501 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Id: b10a90cce1b048d7bd55938811301ab4 Jun 27 19:00:21.075501 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: X-User-Name: tempest-TestVolumeBootPattern-178305863-project Jun 27 19:00:21.075501 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: method: > Jun 27 19:00:21.075501 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: exception: Instance 969bb23c-9265-497a-b68a-70193be0b3f1 could not be found. Jun 27 19:00:21.075501 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: action_args: {'id': '969bb23c-9265-497a-b68a-70193be0b3f1'} Jun 27 19:00:21.076475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: {{(pid=124717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 19:00:21.076475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 19:00:21.076475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 19:00:21.076475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 19:00:21.076475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 19:00:21.076475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 19:00:21.076475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 19:00:21.076475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 19:00:21.076475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 19:00:21.076475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 19:00:21.076475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 969bb23c-9265-497a-b68a-70193be0b3f1 could not be found. Jun 27 19:00:21.076475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 19:00:21.076475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 19:00:21.076475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 19:00:21.076475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 19:00:21.076475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 19:00:21.076475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 19:00:21.076475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 19:00:21.076475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 19:00:21.076475 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 19:00:21.078823 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 19:00:21.078823 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 19:00:21.078823 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 19:00:21.078823 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 19:00:21.078823 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 19:00:21.078823 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 19:00:21.078823 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 19:00:21.078823 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 969bb23c-9265-497a-b68a-70193be0b3f1 could not be found. Jun 27 19:00:21.078823 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 19:00:21.078823 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 19:00:21.078823 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 19:00:21.078823 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 19:00:21.078823 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 19:00:21.078823 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 19:00:21.078823 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 19:00:21.078823 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 19:00:21.078823 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 969bb23c-9265-497a-b68a-70193be0b3f1 could not be found. Jun 27 19:00:21.078823 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: ERROR nova.api.openstack.wsgi Jun 27 19:00:21.080471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: DEBUG nova.api.openstack.wsgi [None req-30da8433-3be2-41af-8d78-10eaebf70963 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Returning 404 to user: Instance 969bb23c-9265-497a-b68a-70193be0b3f1 could not be found. {{(pid=124717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 19:00:21.080471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO nova.api.openstack.requestlog [None req-30da8433-3be2-41af-8d78-10eaebf70963 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1" status: 404 len: 111 microversion: 2.1 time: 0.028790 Jun 27 19:00:21.080471 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: [pid: 124717|app: 0|req: 563/1140] 10.222.0.15 () {58 vars in 1235 bytes} [Mon Jun 27 19:00:21 2022] GET /compute/v2.1/servers/969bb23c-9265-497a-b68a-70193be0b3f1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 19:00:22.580735 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: DEBUG nova.api.openstack.wsgi [None req-ae908be3-3018-47f7-b508-67565d32bbc2 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] Calling method '.version_select at 0x7f700f6f3af0>' {{(pid=124716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 19:00:22.634126 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO nova.api.openstack.requestlog [None req-ae908be3-3018-47f7-b508-67565d32bbc2 tempest-TestVolumeBootPattern-178305863 tempest-TestVolumeBootPattern-178305863-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1210628940" status: 202 len: 0 microversion: 2.1 time: 0.057497 Jun 27 19:00:22.634740 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: [pid: 124716|app: 0|req: 578/1141] 10.222.0.15 () {58 vars in 1262 bytes} [Mon Jun 27 19:00:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1210628940 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 19:00:24.803419 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 19:00:24.804106 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Mon Jun 27 19:00:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 19:03:34.766194 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 19:03:34.766681 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Mon Jun 27 19:03:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 19:03:40.692937 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 19:03:40.693510 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Mon Jun 27 19:03:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 19:03:44.812988 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 19:03:44.813749 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Mon Jun 27 19:03:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 19:05:33.394688 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 19:05:33.395447 dv-cinder-844601-6-iscsi devstack@n-api.service[124716]: Mon Jun 27 19:05:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 19:05:45.812868 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 19:05:45.813380 dv-cinder-844601-6-iscsi devstack@n-api.service[124717]: Mon Jun 27 19:05:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!